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AUTHORS’ PREFACE 


The present course is based on lectures given by I. M. 
Gelfand in the Mechanics and Mathematics Department 
of Moscow State University. However, the book goes 
considerably beyond the material actually presented in 
the lectures. Our aim is to give a treatment of the ele- 
ments of the calculus of variations in a form which is 
both easily understandable and sufficiently modern. 
Considerable attention is devoted to physical applica- 
tions of variational methods, e.g., canonical equations, 
variational principles of mechanics and conservation laws. 


The reader who merely wishes to become familiar with 
the most basic concepts and methods of the calculus of 
variations need only study the first chapter. The first 
three chapters, taken together, form a more compre- 
hensive course on the elements of the calculus of varia- 
tions,-but one which is still quite elementary (involving 
only necessary conditions for extrema). The first six 
chapters contain, more or less, the material given in 
the usual university course in the calculus of variations 
(with applications to the mechanics of systems with a 
finite number of degrees of freedom), including the 
theory of fields (presented in a somewhat novel way) 
and sufficient conditions for weak and strong extrema. 
Chapter 7 is devoted to the application of variational 
methods to the study of systems with infinitely many 
degrees of freedom. Chapter 8 contains a brief treat- 
ment of direct methods in the calculus of variations. 


The authors are grateful to M. A. Yevgrafov and A. G. 
Kostyuchenko, who read the book in manuscript and 
made many useful comments. 
I. M.G. 
S. V. F. 


TRANSLATOR’S PREFACE 


This book is a modern introduction to the calculus of 
variations and certain of its ramifications, and I trust 
that its fresh and lively point of view will serve to make 
it a welcome aldition to the English-language literature 
on the subject. The present edition is rather different 
from the Russian original. With the authors’ consent, 
I have given free rein to the tendency of any mathe- 
matically educated translator to assume the functions 
of annotator and stylist. In so doing, I have had two 
special assets: 1) A substantial list of revisions and 
corrections from Professor S. V. Fomin himself, and 
2) A variety of helpful suggestions from Professor J. T. 
Schwartz of New York University, who read the entire 
translation in typescript. 


The problems appearing at the end of each of the eight 
chapters and two appendices were made specifically for 
the English edition, and many of them comment further 
on the corresponding parts of the text. A variety of 
Russian sources have played an important role in the 
synthesis of this material. In particular, I have consulted 
the textbooks on the calculus of variations by N. I. 
Akhiezer, by L. E. Elsgolts, and by M. A. Lavrentev 
and L. A. Lyusternik, as well as Volume 2 of the well- 
known problem collection by N. M. Gyunter and R. O. 
Kuzmin, and Chapter 3 of G. E. Shilov’s “Mathematical 
Analysis, A Special Course.” 


At the end of the book I have added a Bibliography 
containing suggestions for collateral and supplementary 
reading. This list is not intended as an exhaustive cata- 
log of the literature, and is in fact confined to books 
available in English. 

R.A.S. 
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ELEMENTS 
OF THE THEORY 


I. Functionals. Some Simple Variational Problems 


Variable quantities called functionals play an important role in many 
problems arising in analysis, mechanics, geometry, etc. By a functional, we 
mean a correspondence which assigns a definite (real) number to each function 
(or curve) belonging to some class. Thus, one might say that a functional is 
a kind of function, where the independent variable is itself a function (or 
curve). The following are examples of functionals: 


1. Consider the set of all rectifiable plane curves.! A definite number is 
associated with each such curve, namely, its length. Thus, the length 
of a curve is a functional defined on the set of rectifiable curves. 


2. Suppose that each rectifiable plane curve is regarded as being made 
out of some homogeneous material. Then if we associate with each 
such curve the ordinate of its center of mass, we again obtain a 
functional. 


3. Consider all possible paths joining two given points A and B in the 
plane. Suppose that a particle can move along any of these paths, 
and let the particle have a definite velocity v(x, y) at the point (x, y). 
Then we obtain a functional by associating with each path the time the 
particle takes to traverse the path. 


1Jn analysis, the /ength of a curve is defined as the limiting length of a polygonal line 
inscribed in the curve (i.e., with vertices lying on the curve) as the maximum length of 
the chords forming the polygonal line goes to zero. If this limit exists and is finite, the 
curve is said to be rectifiable. 
I 
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4. Let »(x) be an arbitrary continuously differentiable function, defined 
on the interval [a, b].2 Then the formula 


b ’ 
Jty] = | ¥@) dx 
defines a functional on the set of all such functions y(x). 


5. As a more general example, let F(x, y, z) be a continuous function of 
three variables. Then the expression 


Joy] = [° Fle ye), yO) a () 


where (x) ranges over the set of all continuously differentiable functions 
defined on the interval [a,b], defines a functional. By choosing 
different functions F(x, y,z), we obtain different functionals. For 
exampk, if 
F(x, yz) = V1 + 23, 
J[y] is the length of the curve y = )(x), as in the first example, while if 
F(x, y, z) = z*, 


J(y] reduces to the case considered in the fourth example. In what 
follows, we shall be concerned mainly with functionals of the form (1). 


Particular instances of problems involving the concept of a functional 
were considered more than three hundred years ago, and in fact, the first 
important results in this area are due to Euler (1707-1783). Nevertheless, 
up to now, the “calculus of functionals” still does not have methods of a 
generality comparable to the methods of classical analysis (i.e., the ordinary 
“calculus of functions”). The most developed branch of the “‘calculus of 
functionals” is concerned with finding the maxima and minima of functionals, 
and is called the “calculus of variations.” Actually, it would be more 
appropriate to call this subject the “‘calculus of variations in the narrow 
sense,” since the significance of the concept of the variation of a functional 
is by no means confined to its applications to the problem of determining the 
extrema of functionals. 

We now indicate some typical exampkes of variational problems, by which 
we mean problems involving the determination of maxima and minima of 
functionals. 


1. Find the shortest plane curve joining two points A and B, i.e., find the 
curve y = y(x) for which the functional 


[VT y? ax 


achieves its minimum. The curve in question turns out to be the straight 
line segment joining A and B. 


2 By [a, 5] is meant the closed interval a < x < b. 
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2. Let A and B be two fixed points. Then the time it takes a particle to 
slide under the influence of gravity along some path joining A and B 
depends on the choice of the path (curve), and hence is a functional. 
The curve such that the particle takes the least time to go from A to B 
is called the brachistochrone. The brachistochrone problem was posed 
by John Bernoulli in 1696, and played an important part in the develop- 
ment of the calculus of variations. The problem was solved by John 
Bernoulli, James Bernoulli, Newton, and L’Hospital. The brachisto- 
chrone turns out to be a cycloid, lying in the vertical plane and passing 
through A and B (cf. p. 26). 


3. The following variational problem, called the isoperimetric problem, 
was solved by Euler: Among all closed curves of a given length I, find the 
curve enclosing the greatest area. The required curve turns out to be 
a circle. 


All of the above problems involve functionals which can be written in 
the form 


i ; F(x, y, y’) dx. 


Such functionals have a “localization property” consisting of the fact that 
if we divide the curve y = y(x) into parts and calculate the value of the 
functional for each part, the sum of the values of the functional for the 
separate parts equals the value of the functional for the whole curve. It is 
just these functionals which are usually considered in the calculus of variations. 
As an example of a ‘nonlocal functional,” consider the expression 


i xV1 + y?dx 
[ vite a 


which gives the abscissa of the center of mass of acurve y = y(x),a < x < 6, 
made out of some homogeneous material. 

An important factor in the development of the calculus of variations was 
the investigation of a number of mechanical and physical problems, e.g., 
the brachistochrone problem mentioned above. In turn, the methods of the 
calculus of variations are widely applied in various physical problems. It 
should be emphasized that the application of the calculus of variations to 
physics does not consist merely in the solution of individual, albeit very 
important problems. The so-called “variational principles,” to be discussed 
in Chapters 4 and 7, are essentially a manifestation of very general physical 
laws, which are valid in diverse branches of physics, ranging from classical 
mechanics to the theory of elementary particles. 

To understand the basic meaning of the problems and methods of the 
calculus of variations, it is very important to see how they are related to 
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problems of classical analysis, i.e., to the study of functions of n variables. 
Thus, consider a functional of the form 


Jbl = [Fe yrds YQ =A, y6) = B 


Here, each curve is assigned a certain number. To find a related function 
of the sort considered in classical analysis, we may proceed as follows. 
Using the points 

A=Xo, X1,---) Xn Xn+1 = b, 


we divide the interval [a, b] into n + 1 equal parts. Then we replace the 
curve y = y(x) by the polygonal line with vertices 


(Xo, A), (x1, y(*1)); Ce) (xa yWx5)), (Xn+1 B), 
and we approximate the functional J[y] by the sum 


nt+1 


J(1; oe > Vn) om > F(x % Boh h, (2) 
t=1 


where 
YW = W(X), h =X, — X-1. 


Each polygonal line is uniquely determined by the ordinates y,,..., y, of 
its vertices (recall that y. = A and y,., = B are fixed), and the sum (2) 
is therefore a function of the n variables y,,..., ¥,. Thus, as an approxi- 
mation, we can regard the variational problem as the problem of finding the 
extrema of the function J(),...,y,). In solving variational problems, 
Euler made extensive use of this method of finite differences. By replacing 
smooth curves by polygonal lines, he reduced the problem of finding extrema 
of a functional to the problem of finding extrema of a function of n variables, 
and then he obtained exact solutions by passing to the limit as n— oo. 
In this sense, functionals can be regarded as “functions of infinitely many 
variables” [i.e., the values of the function y(x) at separate points], and the 
calculus of variations can be regarded as the corresponding analog of 
differential calculus. 


2. Function Spaces 


In the study of functions of n variables, it is convenient to use geometric 
language, by regarding a set of m numbers ();,..., ¥,) aS a point in an 
n-dimensional space. In just the same way, geometric language is useful 
when studying functionals. Thus, we shall regard each function y(x) 
belonging to some class as a point in some space, and spaces whose elements 
are functions will be called function spaces. 

In the study of functions of a finite number » of independent variables, 
it is sufficient to consider a single space, i.e., n-dimensional Euclidean space 
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&,.3 However, in the case of function spaces, there is no such ‘‘universal”’ 
space. In fact, the nature of the problem under consideration determines 
the choice of the function space. For example, if we are dealing with a 
functional of the form 


[Fes yy de, 


it is natural to regard the functional as defined on the set of all functions 
with a continuous first derivative, while in the case of a functional of the 
form 


b 
I F(x, y, y', y”) dx, 


the appropriate function space is the set of all functions with two continuous 
derivatives. Therefore, in studying functionals of various types, it is 
reasonable to use various function spaces. 

The concept of continuity plays an important role for functionals, just 
as it does for the ordinary functions considered in classical analysis. In 
order to formulate this concept for functionals, we must somehow introduce 
a concept of “closeness” for elements in a function space. This is most 
conveniently done by introducing the concept of the norm of a function, 
analogous to the concept of the distance between a point in Euclidean space 
and the origin of coordinates. Although in what follows we shall always 
be concerned with function spaces, it will be most convenient to introduce 
the concept of a norm in a more general and abstract form, by introducing 
the concept of a normed linear space. 


By a linear space, we mean a set & of elements x, y, z,... of any kind, 
for which the operations of addition and multiplication by (real) numbers 
a, 8,... are defined and obey the following axioms: 


lLx+y=ytx; 

2.(x+y+z=x+ (74+ 2); 

3. There exists an element 0 (the zero element) such that x + 0 = x for 
any x EB@;* 

4. For each x € &, there exists an element —x such that x + (—x) = 0; 

5. l-x =x; 

6. a(8x) = (@)x; 

7. (a + B)x = ax + Bx; 

8. a(x + y) = ax t+ ay. 


3 See e.g., G. E. Shilov, An Introduction to the Theory of Linear Spaces, translated by 
R. A. Silverman, Prentice-Hall, Inc., Englewood Cliffs, N. J. (1961), Theorem 14 and 
Corollary, pp. 48-49. 

4 By x e #, we mean that the element x belongs to the set #. In these axioms, x, y 
and z are arbitrary elements of #, while a and § are arbitrary real numbers. 
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A linear space # is said to be normed, if each element x €& is assigned a 
nonnegative number ||x||, called the norm of x, such that 


1. ||x|| = Oif and only if x = 0; 
2. fjoxl] = lel falls 
3. |x + yl < [xl + [>I 


In a normed linear space, we can talk about distances between elements, 
by defining the distance between x and y to be the quantity |x — yl. 

The elements of a normed linear space can be objects of any kind, e.g., 
numbers, vectors (directed line segments), matrices, functions, etc. The 
following normed linear spaces are important for our subsequent purposes: 


1. The space @, or more precisely @(a, b), consisting of all continuous 
functions y(x) defined on a (closed) interval [a@, 6). By addition of 
elements of @ and multiplication of elements of @ by numbers, we mean 
ordinary addition of functions and multiplication of functions by 

numbers, while the norm is defined 

as the maximum of the absolute 

value, i.e., 


[yo = max |y)I. 
agi<cb 


Thus, in the space @, the distance 
between the function y*(x) and the 
function y(x) does not exceed « if 
the graph of the function y*(x) lies 
Ficure 1 inside a strip of width 2e (in the 
vertical direction) “‘bordering” the 

graph of the function y(x), as shown in Figure 1. 





2. The space Y,, or more precisely ,(a, b), consisting of all functions 
y(x) defined on an interval [a,b] which are continuous and have 
continuous first derivatives. The operations of addition and multi- 
plication by numbers are the same as in @, but the norm is defined by 
the formula 


yl, = max |y(x)| + max |y’Qd]- 
a<zr<b a<zr<b 
Thus, two functions in B, are regarded as close together if both the 


functions themselves and their first derivatives are close together, since 


ly — zl, <e 
implies that 


ly) — z)| <2, |y¥@) — 2'(X)| <e 


forala<x <b. 
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3. The space Y,, or more precisely 9,(a, b), consisting of all functions 
(x) defined on an interval [a,b] which are continuous and have 
continuous derivatives up to order n inclusive, where n is a fixed integer. 
Addition of elements of 9, and multiplication of elements of 9, by 
numbers are defined just as in the preceding cases, but the norm is 
now defined by the formula 


id 
yl, = >, max |» (x), 
t=0 2<2r<0 


where y(x) = (d/dx)'y(x) and y(x) denotes the function (x) itself. 
Thus, two functions in 9, are regarded as close together if the values 
of the functions themselves and of all their derivatives up to order 1 
inclusive are close together. It is easily verified that all the axioms of a 
normed linear space are actually satisfied for each of the spaces @, Fj, 
and &,,. 


Similarly, we can introduce spaces of functions of several variables, e.g., 
the space of continuous functions of n variables, the space of functions of n 
variables with continuous first derivatives, etc. After a norm has been 
introduced in the linear space @ (which may be a function space), it is 
natural to talk about continuity of functionals defined on @: 


DEFINITION. The functional J{y] is said to be continuous at the point 
JER if for anye > 0, there isa& > 0 such that 
\J{y] - JIPl < ¢, (3) 
provided that | y — f|| < 8. 


Remark 1. The inequality (3) is equivalent to the two inequalities 


J{y])-JIf] > -e (4) 
and 


JTy] — JI¥] < «. (5) 


If in the definition of continuity, we replace (3) by (4), J[y] is said to be ower 
semicontinuous at y, while if we replace (3) by (5), J[y] is said to be upper 
semicontinuous at f. These concepts will be needed in Chapter 8. 


Remark 2. At first, it might appear that the space @, which is the largest 
of those enumerated, would be adequate for the study of variational problems. 
However, this is not the case. In fact, as already mentioned, one of the basic 
types of functionals considered in the calculus of variations has the form 


J] = f° Fes yy) dx. 


It is easy to see that such a functional (e.g., arc length) will be continuous if 
we interpret closeness of functions as closeness in the space Y,. However, 
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in general, the functional will not be continuous if we use the norm intro- 
duced in the space @,° even though it is continuous in the norm of the space 
@,. Since we want to be able to use ordinary analytic methods, e.g., passage 
to the limit, then, given a functional, it is reasonable to choose a function 
space such that the functional is continuous. 


Remark 3. So far, we have talked about linear spaces and functionals 
defined on them. However, in many variational problems, we have to deal 
with functionals defined on sets of functions which do not form linear spaces. 
In fact, the set of functions (or curves) satisfying the constraints of a given 
variational problem, called the admissible functions (or admissible curves), 
is in general not a linear space. For example, the admissible curves for the 
“‘simplest” variational problem (see Sec. 4) are the smooth plane curves 
passing through two fixed points, and the sum of two such curves does not 
pass through the two points. Nevertheless, the concept of a normed linear 
space and the related concepts of the distance between functions, continuity 
of functionals, etc., play an important role in the calculus of variations. A 
similar situation is encountered in elementary analysis, where, in dealing 
with functions of variables, it is convenient to use the concept of an 
n-dimensional Euclidean space &,, even though the domain of definition of 
a function may not be a linear subspace of @,. 


3. The Variation of a Functional. A Necessary Condition 
for an Extremum 


3.1. In this section, we introduce the concept of the variation (or 
differential) of a functional, analogous to the concept of the differential of a 
function of 1 variables. The concept will then be used to find extrema of 
functionals. First, we give some preliminary facts and definitions. 


DEFINITION. Given a normed linear space &, let each element heB 
be assigned anumber oh], i.e., let p[h] be a functional definedon 2. Then 
[A] is said to be a (continuous) linear functional if 

1. [ah] = ap[h] for any he and any real number «; 

2. plhy + he] = elhi] + glhe] for any hy, hz eB; 

3. g[h] is continuous (for all he &). 

Example 1. If we associate with each function A(x) € @(a, b) its value at 
a fixed point Xp in [a, 5], i.e., if we define the functional ¢[h] by the formula 
plh] = A(X), 
then 9 [f] is a linear functional on @(a, b). 
5 Arc length is a typical example of such a functional. For every curve, we can find 


another curve arbitrarily close to the first in the sense of the norm of the space ©, whose 
length differs from that of the first curve by a factor of 10, say. 
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Example 2. The integral 
lh] = f° Wx) de 
defines a linear functional on (a, 6). 
Example 3. The integral 
lh] = f° aGeyi(x) dx, 


where a(x) is a fixed function in @(a, 5), defines a linear functional on @(a, 6). 


Example 4. More generally, the integral 
b 
glh] = ii [xo(xpA(x) + a(xph'(x) +--+ + an(xph™(x)] dx, (6) 


where the «,(x) are fixed functions in ¢(a, 6), defines a linear functional 
on J,(a, b). 


Suppose the linear functional (6) vanishes for all A(x) belonging to some 
class. Then what can be said about the functions a(x)? Some typical 
results in this direction are given by the following lemmas: 


Lemma 1. Jf a(x) is continuous in (a, b), and if 
| ” a(x\i(x) dx = 0 


for every function h(x) € @(a, b) such that h(a) = h(b) = 0, then a(x) = 0 
for all x in [a, 6]. 


Proof. Suppose the function a(x) is nonzero, say positive, at some 
point in [a,b]. Then a(x) is also positive in some interval [x,, x2] 
contained in [a, 5]. If we set 


W(x) = (x — x1)(%2 — x) 
for x in [x,, x2] and A(x) = 0 otherwise, then A(x) obviously satisfies 
the conditions of the lemma. However, 


fF a@n(x) dx = {* ai — x(a — x) dx > 0, 


since the integrand is positive (except at x, and x2). This contradiction 
proves the lemma. 


Remark. The lemma still holds if we replace @(a, b) by F,(a, b). To 
see this, we use the same proof with 


h(x) = [(x — *1)(%2 — x))"*? 


for x in [x,, x2] and A(x) = 0 otherwise. 
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LEMMA 2. If a(x) is continuous in [a, b], and if 
b 
i} a(x)h'(x) dx = 0 


for every function h(x)¢€Q,(a, 6b) such that h(a) = h(b) = 0, then 
a(x) = c for all x in [a, b), where c is a constant. 


Proof. Let c be the constant defined by the condition 
il a(x) — c] dx = 0, 
and let 
h(x) = | (a) - el ae, 


so that A(x) automatically belongs to Y,(a, b) and satisfies the con- 
ditions h(a) = h(b) = 0. Then on the one hand, 


[ [a(x) — clh'(x) dx = i a(x)h'(x) dx — clh(b) — h(a)] = 0, 
while on the other hand, 
[ e@ - cwedx = [ &@) - cP dx. 
It follows that a(x) — ¢ = 0, ie., a(x) = ¢, for alll x in [a, 5}. 


The next lemma will be needed in Chapter 8: 
Lemma 3. Ifa(x) is continuous in [a, b], and if 


f ” a(x)h'(x) dx = 0 


for every function h(x) D(a, b) such that h(a) = h(b) = 0 and 
h(a) = h'(b) = 0, then a(x) = cp + ¢,x for all x in [a,b], where co and cy 
are constants. 


Proof. Let cy and c, be defined by the conditions 
b 
I [a(x) — co - cx] dx = 0, 


hrs ( 
[, ax J faE) - co — cx€] dé = 0, ‘ 


and let 
Wx) = f° def a(t) — 9 — et dt, 


so that A(x) automatically belongs to 9,(a, b) and satisfies the conditions 
h(a) = h(b) = 0, h(a) = h'(b) = 0. Then on the one hand, 


if [a(x) - €9 — cyx]h"(x) dx 


f "ao (x) de — eolh'(B) — KOI — ¢ f ” ch"(x) dx 
= —c,[bh'(b) — ah'(a)] — c,[h(b) — A(a)] = 0, 
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while on the other hand, 
b 
J [of{x) — Cp — ¢,x]h"(x) dx = i [a(x) — ¢o — ¢yx]*dx = 0. 
It follows that o{(x) — cy — c,x = 0, i.e., a(x) = co + cx, for all x in 
{a, 5). 
Lemma 4. If a(x) and B(x) are continuous in {a, b], and if 


[. e@oe) + BOOM @] dx = 0 (8) 
for every function h(x) € Q,(a, b) such that h(a) = h(b) = 0, then B(x) 
is differentiable, and B'(x) = «(x) for all x in [a, 6). 

Proof. Setting 
A(x) = | a(€) dé, 
and integrating by parts, we find that 
fF econ) dx = — [ ” ACoh'(x) dx, 

i.e., (8) can be rewritten as 

[ [—A(x) + BOOJA'(x) dx = 0. 


But, according to Lemma 2, this implies that 
B(x) — A(x) = const, 
and hence by the definition of A(x), 
B(x) = a(x), 


for all x in [a, 5], as asserted. We emphasize that the differentiability 
of the function B(x) was not assumed in advance. 


3.2. We now introduce the concept of the variation (or differential) of a 
functional. Let J[y] be a functional defined on some normed linear space, 
and let 


AJ{h] = Jy + h} — Jf] 


be its increment, corresponding to the increment # = A(x) of the “independent 
variable” y = y(x). If » is fixed, AJ[A] is a functional of 4, in general a 
nonlinear functional. Suppose that 


AJ{h] = off] + lal, 


where [A] is a linear functional and «-> 0 as ||h|| +0. Then the functional 
J[y] is said to be differentiable, and the principal linear part of the increment 
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AJA], i.e., the linear functional [A] which differs from AJ[A] by an infinitesi- 
mal of order higher than 1 relative to ||A||, is called the variation (or differ- 
ential) of J[y] and is denoted by 8J[A].° 


THEOREM |. The differential of a differentiable functional is unique. 


Proof. First, we note that if p[A] is a linear functional and if 


oll, 

[Al 
as ||Al| > 0, then 9[h] = 0, i-e., p[A] = 0 for all A. In fact, suppose 
elo] £ Ofor some hy 4 0. Then, setting 





, 1, 9, = ltel, 
“A oll 
we see that ||h,|| > 0 as n—> oo, but 
. hy] nolo] 
lim pals = lim =i#£0, 
avo |lhal| nm nll 


contrary to hypothesis. 
Now, suppose the differential of the functional J[y] is not uniquely 
defined, so that 
AJ{h] = ¢,[h] + ex |All, 
AJ{h] = palh] + e2lAll, 


where ¢,[A] and ¢.[A] are linear functionals, and ¢,, 2 > 0 as ||A|| > 0. 
This implies 

gill] — alk] = eglh|l 
and hence ¢,[h] — ¢.2[A] is an infinitesimal of order higher than | relative 


to ||A||. But since p,[h] — [A] is a linear functional, it follows from the 
first part of the proof that ,[h] — ¢2[A] vanishes identically, as asserted. 


Next, we use the concept of the variation (or) differential of a functional 
to establish a necessary condition for a functional to have an extremum. 
We begin by recalling the corresponding concepts from analysis. Let 
F(x,,..., X,) be a differentiable function of variables. Then F(x%,..., X,) 
is said to have a (relative) extremum at the point (X,,..., %,) if 


AF = F(x,,..-, Xn) — Fi, ..-s Xn) 


has the same sign for all points (x%;,..., x,) belonging to some neighborhood 
of (%,,..., %,), where the extremum F(%,,..., %,) is a minimum if AF > 0 
and a maximum if AF < 0. 

Analogously, we say that the functional J[y] has a (relative) extremum 
for y = y if J[y] — J[j] does not change its sign in some neighborhood of 


§ Strictly speaking, of course, the increment and the variation of J[y], are functionals 
of two arguments y and 4&4, and to emphasize this fact, we might write AJ[y; h] = 
dJ[y; A) + ellAl. 
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the curve y = (x). Subsequently, we shall be concerned with functionals 
defined on some set of continuously differentiable functions, and the functions 
themselves can be regarded either as elements of the space @ or elements 
of the space Y,. Corresponding to these two possibilities, we can define 
two kinds of extrema: We shall say that the functional J[y] has a weak 
extremum for y = f if there exists an « > O such that J[y] — J[f] has the 
same sign for all y in the domain of definition of the functional which satisfy 
the condition ||y — §||, < e, where | ||, denotes the norm in the space Jj. 
On the other hand, we shall say that the functional J[y] has a strong extremum 
for y = 9 if there exists an « > O such that J[y] — J[f] has the same sign 
for all y in the domain of definition of the functional which satisfy the 
condition ||y — fl) < ©, where | ||) denotes the norm in the space @. 
It is clear that every strong extremum is simultaneously a weak extremum, 
since if | y — Jl, < , then ||y — Slo < ©, a fortiori, and hence, if J[] is 
an extremum with respect to all y such that ||y — Silo < «, then J[J] is 
certainly an extremum with respect to all y such that ||y — fl], <«. How- 
ever, the converse is not true in general, i.e., a weak extremum may not be a 
strong extremum. As a rule, finding a weak extremum is simpler than 
finding a strong extremum. The reason for this is that, the functionals 
usually considered in the calculus of variations are continuous in the norm 
of the space Y, (as noted at the end of the previous section), and this con- 
tinuity can be exploited in the'theory of weak extrema. In general, however, 
our functionals will not be continuous in the norm of the space @. 


THEOREM 2. A necessary condition for the differentiable functional 
J[y] to have an extremum for y = is that its variation vanish for y = J, 
i.e., that 

dJ[h] = 0 
for y = ¥ and all admissible h. 


Proof. To be explicit, suppose J[y] has a minimum for y = 9. 
According to the definition of the variation 8J [h], we have 


AJTA] = 84h] + ell) 0) 
where e-> 0 as |A|| > 0. Thus, for sufficiently small ||A||, the sign of 
AJ{h] will be the same as the sign of SJ[h]. Now, suppose that 
3J [ho] # 0 for some admissible 4p. Then for any « > 0, no matter 
how small, we have 

dJ[—ah] = —SJ [ah]. 


Hence, (9) can be made to have either sign for arbitrarily small |A|. 
But this is impossible, since by hypothesis J[y] has a minimum for y = f, 
i.e., 

AJ[h] = J[p + kA] — JL¥] > 0 


for all sufficiently small ||A||. This contradiction proves the theorem. 
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Remark. In elementary analysis, it is proved that for a function to have 
a minimum, it is necessary not only that its first differential vanish (df = 0), 
but also that its second differential be nonnegative. Consideration of the 
analogous problem for functionals will be postponed until Chapter 5. 


4. The Simplest Variational Problem. Euler’s Equation 


4.1, We begin our study of concrete variational problems by considering 
what might be called the “simplest” variational problem, which can be 
formulated as follows: Let F(x, y, z) be a function with continuous first and 
second (partial) derivatives with respect to all its arguments. Then, among 
all functions y(x) which are continuously differentiable for a< x <b and 
Satisfy the boundary conditions 


ya)= A, yb) =B, (10) 


find the function for which the functional 


Ji] = f° FO, yy) dx ay 


has a weak extremum. In other words, the simplest variational problem 
consists of finding a weak extremum of a functional of the form (11), where 
the class of admissible curves (see p. 8) consists of all smooth curves joining 
two points. The first two examples on pp. 2, 3, involving the brachistochrone 
and the shortest distance between two points, are variational problems of 
just this type. To apply the necessary condition for an extremum (found in 
Sec. 3.2) to the problem just formulated, we have to be able to calculate the 
variation of a functional of the type (11). We now derive the appropriate 
formula for this variation. 
Suppose we give y(x) an increment A(x), where, in order for the function 


Wx) + A(x) 
to continue to satisfy the boundary conditions, we must have 
h(a) = h(b) = 0. 
Then, since the corresponding increment of the functional (11) equals 
AJ =Jly +h) - ID) =f Foay + hy + ade — [FO yy) de 
=f Fy + hy +h) — Fes y, yds, 


it follows by using Taylor’s theorem that 


b 
AJ = | LRG y yh + Fy 9, yw] dx +o, a2) 
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where the subscripts denote partial derivatives with respect to the corres- 
ponding arguments, and the dots denote terms of order higher than | relative 
tohandh’. The integral in the right-hand side of (12) represents the principal 
linear part of the increment AJ, and hence the variation of J[y] is 


b 
87 = [LEG yy + Fy ys yh] dx. 


According to Theorem 2 of Sec. 3.2, a necessary condition for J/[y] to have 
an extremum for y = (x) is that 


ay = | (Eh + Eyh’) dx = 0 (13) 


for all admissible A. But according to Lemma 4 of Sec. 3.1, (13) implies 
that 
d 


See 


Fy, =0, (14) 


a result known as Euler’s equation.’ Thus, we have proved 


THEOREM 1. Let J[y] be a functional of the form 


ii F(x, y, y’) dx, 


defined on the set of functions y(x) which have continuous first derivatives 
in [a, b] and satisfy the boundary conditions y(a) = A, y(b) = B. Then 
a necessary condition for J[y] to have an extremum for a given function 
yx) is that (x) satisfy Euler’s equation® 


d 


Iya 


Fy = 0. 

The integral curves of Euler’s equation are called extremals. Since 
Euler’s equation is a second-order differential equation, its solution will in 
general depend on two arbitrary constants, which are determined from the 
boundary conditions y(a) = A, y(b) = B. The problem usually considered 
in the theory of differential equations is that of finding a solution which is 
defined in the neighborhood of some point and satisfies given initial con- 
ditions (Cauchy’s problem). However, in solving Euler’s equation, we are 
looking for a solution which is defined over all of some fixed region and 
satisfies given boundary conditions. Therefore, the question of whether 
or not a certain variational problem has a solution does not just reduce to the 


7 We emphasize that the existence of the derivative (d/dx)F,- is not assumed in 
advance, but follows from the very same lemma. 

® This condition is necessary for a weak extremum. Since every strong extremum is 
simultaneously a weak extremum, any necessary condition for a weak extremum is 
also a necessary condition for a strong extremum. 
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usual existence theorems for differential equations. In this regard, we now 
state a theorem due to Bernstein,® concerning the existence and uniqueness of 
solutions “in the large” of an equation of the form 


y” = F(x, y, y’). (15) 


THEOREM 2 (Bernstein). If the functions F, F, and F,. are continuous 
at every finite point (x, y) for any finite y’, and if a constant k > 0 and 
functions 


a=a(x,y)20, B=, y) 20 


(which are bounded in every finite region of the plane) can be found such 
that 


F(xy,y)>k,  |FOayy')| < ay? + B, 


then one and only one integral curve of equation (15) passes through any 
two points (a, A) and (b, B) with different abscissas (a # 6). 


Equation (13) gives a necessary condition for an extremum, but in general, 
one which is not sufficient. The question of sufficient conditions for an 
extremum will be considered in Chapter 5. In many cases, however, 
Euler’s equation by itself is enough to give a complete solution of the prob- 
lem. In fact, the existence of an extremum is often clear from the physical or 
geometric meaning of the problem, e.g., in the brachistochrone problem, 
the problem concerning the shortest distance between two points, etc. If in 
such a case there exists only one extremal satisfying the boundary conditions 
of the problem, this extremal must perforce be the curve for which the 
extremum is achieved. 

For a functional of the form 


[Fou yy) de 


Euler’s equation is in general a second-order differential equation, but it 
may turn out that the curve for which the functional has its extremum is 
not twice differentiable. For example, consider the functional 


1 
Jty] = [x — y'P dx, 
where 
W-1)=0, yl) = 1. 
The minimum of J[y] equals zero and is achieved for the function 


0 for -l<x<0, 


a oe x? for O<x<l, 


®S. N. Bernstein, Sur les équations du calcul des variations, Ann. Sci. Ecole Norm. 
Sup.,29, 431-485 (1912). 
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which has no second derivative for x = 0. Nevertheless, y(x) satisfies 
the appropriate Euler equation. In fact, since in this case 


F(x, y, y') = (2x — y'f, 
it follows that all the functions 
a 
dx 
vanish identically for -1 < x < 1. Thus, despite the fact that Euler’s 
equation is of the second order and y’(x) does not exist everywhere in 
[—1, 1], substitution of )(x) into Euler’s equation converts it into an identity. 


We now give conditions guaranteeing that a solution of Euler’s equation 
has a second derivative: 


F, = 29x — y'), Fy = —2y°(2x — y’), Fy 


THEOREM 3. Suppose y = y(x) has a continuous first derivative and 
satisfies Euler’s equation 
d 
dx 
Then, if the function F(x, y, y’) has continuous first and second derivatives 
with respect to all its arguments, y(x) has a continuous second derivative 
at all points (x, y) where 


Fy-y[x, v(x), y'(x)] # 0. 
Proof. Consider the difference 


AF, = F,(x + Ax, y + Ay, y’ + Ay’) — Fy, yy) 
= AxFy, + AyFy, + Ay’Fyy, 


F,-—+F, =0. 


where the overbar indicates that the corresponding derivatives are evalu- 
ated along certain intermediate curves. We divide this difference by 
Ax, and consider the limit of the resulting expression 


Ay’ = 


= Ay = 
Te Fy + Ay Pov 


Fye + Ay 


asAx->0. (This limit exists, since F, has a derivative with respect to 
x, which, according to Euler’s equation, equals F,.) Since, by hypoth- 
esis, the second derivatives of F(x, y,z) are continuous, then, as 
Ax — 0, F,, converges to F,,;, i.e., to the value of ?F/dy’ éx at the point 
x. It follows from the existence of y’ and the continuity of the second 
derivative F,, that the second term (Ay/Ax)F,y also has a limit as 
Ax—0. But then the third term also has a limit (since the limit of the 
sum of the three terms exists), i.e., the limit 


. Aya 
jm Ax 
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exists. As Ax—0, F,y converges to Fy, # 0, and hence 


te A ct ak 
in Eye 


’ 


exists. Finally, from the equation 
a 
dx 
we can find an expression for y", from which it is clear that y” is 
continuous wherever F,-,,- # 0. This proves the theorem. 


Fy — F, =90, 


Remark. Here it is assumed that the extremals are smooth.’° In Sec. 15 
we shall consider the case where the solution of a variational problem may 
only be piecewise smooth, i.e., may have “‘corners”’ at certain points. 


4.2, Euler’s equation (14) plays a fundamental role in the calculus of 
variations, and is in general a second-order differential equation. We now 
indicate some special cases where Euler’s equation can be reduced to a first- 
order differential equation, or where its solution can be obtained entirely 
in terms of quadratures (i.e., by evaluating integrals). 


Case 1. Suppose the integrand does not depend on y, i.e., let the functional 
under consideration have the form 


o 
J F(x, y’) dx, 
a 
where F does not contain y explicitly. In this case, Euler’s equation becomes 
d 
ax Fy = 0, 
which obviously has the first integral 
Fy =C, (16) 


where C is a constant. This is a first-order differential equation which 
does not contain y. Solving (16) for y’, we obtain an equation of the form 


y’ = I(x, C), 
from which y can be found by a quadrature. 


Case 2, If the integrand does not depend on x, i.e., if 


. , 
J[y] = [ F(y, y’) dx, 
then 
d 


Fy - a Fy = Fy — Fyyy' — Fyyy". (17) 


10 We say that the function )(x) is smooth in an interval [a, 5) if it is continuous in 
(a, 5), and has a continuous derivative in [a,b]. We say that y(x) is piecewise smooth in 
(a, 5) if it is continuous everywhere in [a, 5], and has a continuous derivative in [a, 5] 
except possibly at a finite number of points. 
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Multiplying (17) by »’, we obtain 
Fyy' — Fyyy? — Fyyy'y" = 4 (F — y'F,). 
Thus, in this case, Euler’s equation has the first integral 
F-y'F, =C, 
where C is a constant. 
Case 3. If F does not depend on y', Euler’s equation takes the form 
F(x, y) = 0, 


and hence is not a differential equation, but a “finite”? equation, whose 
solution consists of one or more curves y = )(x). 


Case 4. In a variety of problems, one encounters functionals of the form 


[ feo VT 497 as, 


representing the integral of a function f(x, y) with respect to the arc length 
s(ds = V1 + y dx). In this case, Euler’s equation can be transformed 
into 


7 a ye 
=f,V1+y? +? a 1+y? —Sy V1+ y? SG + y’2)3/2 


oe eee eee (ee 7] - 
a VT + y2 [4 Sy tj + y2 = 0, 


Fire | a 
ty Sy ITF 0. 


Example 1. Suppose that 


Ma a 
x 


ol =f y(1) = 0, (2) =1. 


The integrand does not contain y, and hence Euler’s equation has the form 
Fy, = C (cf. Case 1). Thus, 


, 


y 


xV1l+y” a 
so that 
y(1 oe C2x?) = C2x2 
or 


ae Cx 
ee ares 
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from which it follows that 





Cx dx 1 a3 
»-|(_Sa aa =avl—- CH +O, 
or 

1 


(y- C2? += rors 


Thus, the solution is a circle with its center on the y-axis. From the 
conditions y(1) = 0, y(2) = 1, we find that 


so that the final solution is 
(y — 2)? + x? = 5. 


Example 2. Among all the curves joining two given points (Xo, Yo) and 
(x4, 1), find the one which generates the surface of minimum area when rotated 
about the x-axis. As we know, the area of the surface of revolution generated 
by rotating the curve » = y(x) about the x-axis is 


2n ie yV 1 + y'? dx. 
To 


Since the integrand does not depend explicitly on x, Euler’s equation has the 
first integral 


F-y'Fy =C 
(cf. Case 2), i-e., 
vI+y? z 
+ y? — =C 
” P: . V1 + y? 
or 
y=Cvl + y?, 
so that 
, y _— C2 
y= C2 
Separating variables, we obtain 
ee C dy 
Vy? — C2 
i.e., 
2. (2 
cece ein 2 Vy 
Cc 
so that 
y = Ccosh mata (18) 
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Thus, the required curve is a catenary passing through the two given 
points. The surface generated by rotation of the catenary is called a catenoid. 
The values of the arbitrary constants C and C, are determined by the 
conditions 

Y(%o) = Yo; Wx) = Vr. 


It can be shown that the following three cases are possible, depending on 
the positions of the points (%o, yo) and (x1, 3): 


1. If a single curve of the form (18) can be drawn through the points 
(Xo, ¥o) and (x,y), this curve is the solution of the problem [see 
Figure 2(a)]. 


2. If two extremals can be drawn through the points (x9, Yo) and (x, yi), 
one of the curves actually corresponds to the surface of revolution 
of minimum area, and the other does not. 


w 


. If there is no curve of the form (18) passing through the points (%o, yo) 
and (x,, y,), there is no surface in the class of smooth surfaces of revo- 
lution which achieves the minimum area. In fact, if the location of the 





FIGuRE 2 


two points is such that the distance between them is sufficiently large 
compared to their distances from the x-axis, then the area of the surface 
consisting of two circles of radius yo and y;, plus the segment of the 
x-axis joining them [see Figure 2(b)] will be less than the area of any 
surface of revolution generated by a smooth curve passing through the 
points. Thus, in this case the surface of revolution generated by the 
polygonal line 4x,x,B has the minimum area, and there is no surface 
of minimum area in the class of surfaces generated by rotation about the 
x-axis of smooth curves passing through the given points. (This case, 
corresponding to a “broken extremal,”’ will be discussed further in 
Sec. 15.) 


Example 3. For the functional 


Ji = [P= was, (19) 
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Euler’s equation reduces to a finite equation (see Case 3), whose solution 
is the straight line y = x. In fact, the integral (19) vanishes along this line. 


5. The Case of Several Variables 


So far, we have considered functionals depending on functions of one 
variable, i.e., on curves. In many problems, however, one encounters 
functionals depending on functions of several independent variables, i.e., on 
surfaces. Such multidimensional problems will be considered in detail in 
Chapter 7. For the time being, we merely give an idea of how the formula- 
tion and solution of the simplest variational problem discussed above carries 
over to the case of functionals depending on surfaces. 

To keep the notation simple, we confine ourselves to the case of two 
independent variables, but all our considerations remain the same when there 
are n independent variables. Thus, let F(x, y, z, p,q) be a function with 
continuous first and second (partial) derivatives with respect to all its argu- 
ments, and consider a functional of the form 


Ite] = ff Fs y 220 24) dx dy, (20) 


where R is some closed region and z,, z, are the partial derivatives of 
z = z(x,y). Suppose we are looking for a function z(x, y) such that 


1. z(x, y) and its first and second derivatives are continuous in R; 

2. 2(x, y) takes given values on the boundary I of R; 

3. The functional (20) has an extremum for z = z(x, y). 
Since the proof of Theorem 2 of Sec. 3.2 does not depend on the form of 
the functional J, then, just as in the case of one variable, a necessary condition 
for the functional (20) to have an extremum is that its variation (i.e., the 
principal linear part of its increment) vanish. However, to find Euler’s 


equation for the functional (20), we need the following lemma, which is 
analogous to Lemma | of Sec. 3.1 (see also the remark on p. 9): 


Lemma. If a(x, y) is a fixed function which is continuous in a closed 


region R, and if the integral 


[ J, 2s sil, ») dx dy (21) 


vanishes for every function h(x, y) which has continuous first and second 
derivatives in R and equals zero on the boundary T of R, then a(x, y) = 0 
everywhere in R. 


Proof. Suppose the function «(x, y) is nonzero, say positive, at 
some point in R. Then a(x, y) is also positive in some circle 


(x — Xo)? + (y — Yo)? < ©? (22) 
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contained in R, with center (xo, yo) and radius «. If we set A(x, y) = 0 
outside the circle (22) and 


A(x, y) = [(% — Xo)? + (¥ — Yo)? — &?P 


inside the circle, then A(x) satisfies the conditions of the lemma. How- 
ever, in this case, (21) reduces to an integral over the circle (22) and is 
obviously positive. This contradiction proves the lemma. 


In order to apply the necessary condition for an extremum of the functional 
(20), i.e., J = 0, we must first calculate the variation 8J. Let A(x, y) be an 
arbitrary function which has continuous first and second derivatives in the 
region R and vanishes on the boundary I’ of R. Then if z(x, y) belongs to 
the domain of definition of the functional (20), so does z(x, y) + A(x, y). 
Since 

AJ = J[z + h] - J[z] = ne LF(x, yy z+ My Ze + Igy Zy + hy) 


— F(x, y, 2, Zz, Zy)] dx dy, 
it follows by using Taylor’s theorem that 


As = f ie (Fh + F,,h, + Fe,hy) dx dy +--+, 


where the dots denote terms of order higher than | relative to h, h, and hy. 
The integral on the right represents the principal linear part of the increment 
AJ, and hence the variation of J[z] is 


a= { i (Fh + F,,hy + Fe,hy) dx dy. 
Next, we observe that 


le (F.,h, + F.,h,) dx dy 


= J, [ge + 5 en] axdy -[f (Ga. + FA) axa 


= [ Ehdy— Bhs) — fff (Fe + 5 Fs) h dx dy, 


where in the last step we have used Green’s theorem? 


I, (2 -$) dx dy = | (Pdx + Qdy). 


The integral along I is zero, since A(x, y) vanishes on I, and hence, comparing 
the last two formulas, we find that 


Q 7) 
i= J ie (F. aa F.,) h(x, y) dx dy. (23) 


11 See e.g., D. V. Widder, Advanced Calculus, second edition, Prentice-Hall, Inc., 
Englewood Cliffs, N.J. (1961), p. 223. 
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Thus, the condition J = 0 implies that the double integral (23) vanishes for 
any A(x, y) satisfying the stipulated conditions. According to the lemma, 
this leads to the following second-order partial differential equation, again 
known as Euler’s equation: 

rs) 0 


F, 2 Oy v 


We are looking for a solution of (24) which takes given values on the 
boundary I. 


Example. Find the surface of least area spanned by a given contour. 
This problem reduces to finding the minimum of the functional 


Jt = ff vi + z2 4+ 22 dx dy, 


so that Euler’s equation has the form 


r(1 + g?) — 2spq + ¢(1 + p*) = 0, (25) 
where 
P=2Z, (=2Zy = 2 S=Zy, = Zyy. 
Equation (25) has a simple geometric meaning, which we explain by using 
the formula 
5 (2 -| - “ae 


MS aN. Foal EG = 


for the mean curvature of the surface, where E, F, G and e, f, g are the 
coefficients of the first and second fundamental quadratic forms of the 
surface.!? If the surface is given by an explicit equation of the form 
z = 2(x, y), then 
E=1+p*, F=pq, G=1+@, 
= r f= s g= t 
Vi +p? +q? V1 +p? + q Vi+p?+¢@ 


and hence 


e 


(1_+ p*)t — 2spq + (1 + 9°)r 
M oe 
V1 +p? + ¢ 
Here, the numerator coincides with the left-hand side of Euler’s equation 


(25). Thus, (25) implies that the mean curvature of the required surface 
equals zero. Surfaces with zero mean curvature are called minimal surfaces. 


12 See e.g., D. V. Widder, op. cit., Chap. 3, Sec. 6, and E. Kreysig, Differential 
Geometry, University of Toronto Press, Toronto (1959), Chap.4. Here,x, and x2 denote 
the principal normal curvatures of the surface. 
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6. A Simple Variable End Point Problem 


There are, of course, many other kinds of variational problems besides 
the “‘simplest” variational problem considered so far, and such problems 
will be studied in Chapters 2 and 3. However, this is a suitable place for 
acquainting the reader with one of these problems, i.e., the variable end 
point problem, a particular case of which can be stated as follows: Among all 
curves whose end points lie on two given vertical lines x = a and x = b, 
find the curve for which the functional 


Jb = f° Fey») ax (26) 


has an extremum." 
We begin by calculating the variation 5/ of the functional (26). As 
before, 5J means the principal linear part of the increment 


bo 
AJ =Jly + A) — Jb) = [Gy + hay! +H) — Fay, vax. 
Using Taylor’s theorem to expand the integrand, we obtain 
b 
AJ = | (Rh + Fyhl)dx +++, 
a 


where the dots denote terms of order higher than | relative to A and h’, and 
hence 


ay = ” (Eh + Fyh’) dx. 


Here, unlike the fixed end point problem, A(x) need no longer vanish at the 
points a and 5b, so that integration by parts now gives'* 


b d - 
BJ = | (Fy — gy Fr) Ma) dx + FAG 
: | i ee (27) 
= [PB ~ gy Fe) Ma de + Frlenn MO) — Fylena h(a. 


We first consider functions A(x) such that A(z) = h(b) = 0. Then, as in 
the simplest variational problem, the condition 8J = 0 implies that 
d 
F,- atv = 0. (28) 
Therefore, in order for the curve y = y(x) to be a solution of the variable 
end point problem, y must be an extremal, i.e., a solution of Euler’s equation. 


13 The more general case where the end points lie on two given curves y = @(x) and 
y = Ux) is treated in Sec. 14. 
14 As usual, f(x)|722 stands for f(b) — f(a). 
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But if y is an extremal, the integral in the expression (27) for 8J vanishes, 
and then the condition 5J = 0 takes the form 


Fy|r=» A(b) — Fy|z=2 h(a) = 9, 
from which it follows that 
Fy \rwa = 0, Flea = 0, (29) 


since A(x) is arbitrary. Thus, to solve the variable end point problem, we 
must first find a general integral of Euler’s equation (28), and then use the 
conditions (29), sometimes called the natural boundary conditions, to determine 
the values of the arbitrary constants. 

Besides the case of fixed end points and the case of variable end points, 
we can also consider the mixed case, where one end is fixed and the other is 
variable. For example, suppose we are looking for an extremum of the 
functional (26) with respect to the class of curves joining a given point A 
(with abscissa a) and an arbitrary point of the line x = 6. In this case, the 
conditions (29) reduce to the single condition 


Fy|e-b = 0, 


and y(a) = A serves as the second boundary condition. 


Example. Starting from the point P = (a, A), a heavy particle slides 
down a curve in the vertical plane. Find the curve such that the particle 
reaches the vertical line x = b (#a) in the shortest time. (This is a variant 
of the brachistochrone problem, p. 3.) 


For simplicity, we assume that the original point coincides with the origin 
of coordinates. Since the velocity of motion along the curve equals 


we have 


so that the transit time T is given by the equation 
T= (sees 1+ y? os 
Vv 2gy 2gy 


The general solution of the corresponding Euler equation consists of a 
family of cycloids 


x = r(6 — sin 8) + ¢, y =r(] — cos 8). 
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Since the curve must pass through the origin, we must have c= 0. To 
determine r, we use the second condition 
Fy = eee ee = 
V2gy V1 + yy? 
i.e., y’ = O for x = b, which means that the tangent to the curve at its right 
end point must be horizontal. It follows that r = b/x, and hence the 
required curve is given by the equations 


0 for x = 5, 


Ale 


x = 2 — sin®), y = —(I — cos 8). 


7. The Variational Derivative 


In Sec. 3.2 we introduced the concept of the differential of a functional. 
We now introduce the concept of the variational (or functional) derivative, 
which plays the same role for functionals as the concept of the partial 
derivative plays for functions of n variables. We begin by considering 
functionals of the type 


JDL=[ Fy rds, a) = 4, (6) = B, (30) 


corresponding to the simplest variational problem. Our approach is to 
first go from the variational problem to an n-dimensional problem, and then 
pass to the limit n > oo. 

Thus, we divide the interval [a,b] into n + 1 equal subintervals by 
introducing the points 


Xo = A, X1,-+-y Xn, Xnv1 = 5, (X41 — x, = Ax), 
and we replace the smooth function y(x) by the polygonal line with vertices 
(Xo, Yo)s (1, Yi), eee (Xn Yn)s (Xn4+1 Yn+i)s 
where y, = y(x,).1° Then (30) can be approximated by the sum 


TOs. In) =D F (i A") A, G1) 
t=0 


which is a function of n variables. (Recall that yp = A and y,,,; = B are 
fixed.) 
Next, we calculate the partial derivatives 


OJ(V1; vey Yn), 
OY. 
and we consider what happens to these derivatives as the number of points 
of subdivision increases without limit. Observing that each variable y, 


1% This is the method of finite differences (cf. Secs. 1, 40). 
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in (31) appears in just two terms, corresponding to i= k and i=k — 1, 
we find that 


(32) 
+ Fy (x1, Ve-. tes eo) — Fy (x, Vko areal 


As Ax — 0, i.e., as the number of points of subdivision increases without 
limit, the right-hand side of (32) obviously goes to zero, since it is a quantity 
of order Ax. In order to obtain a limit which is in general nonzero as 
Ax — 0, we divide (32) by Ax, obtaining 


oJ = Vi+1 — 2s) 
oy, Ax a F, (x. Vrs Ax 


1 - — Vee 
~ Ax [F. (xs Ys eas — 2) — Fy (x1, Ve-1s Yes dens}. 


We note that the expression dy, Ax appearing in the denominator on the left 
has a direct geometric meaning, and is in fact just the area of the region 
lying between the solid and the dashed curves in Figure 3. 





FIGuRE 3 


As Ax-> 0, the expression (33) converges to the limit 


SJ F d , 
3y = F(x, y, y’') = qx Ful Ys ¥)s 


called the variational derivative of the functional (30). We see that the 
variational derivative 8J/Sy is just the left-hand side of Euler’s equation 
(28), and hence the meaning of Euler’s equation is just that the variational 
derivative of the functional under consideration should vanish at every point. 
This is the analog of the situation encountered in elementary analysis, where 
a necessary condition for a function of variables to have an extremum is 
that all its partial derivatives vanish. 

In the general case, the variational derivative is defined as follows: Let 
J[y] be a functional depending on the function (x), and suppose we give 
y(x) an increment A(x) which is different from zero only in the neighborhood 
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of a point x9. Dividing the corresponding increment J[y + A] — J[y] of 
the functional by the area Ao lying between the curve y = A(x) and the 
x-axis,!® we obtain the ratio 


J{y + A] - Jfy) 


ae (34) 


Next, we let the area Ac go to zero in such a way that both max |A(x)| and 
the length of the interval in which A(x) is nonvanishing go to zero. Then, 
if the ratio (34) converges to a limit as Ac—0, this limit is called the 
variational derivative of the functional J[y] at the point x) [for the curve 
y = y(x)], and is denoted by 

aJ 

8y|2=20 


It can be shown that the analogs of all] the familiar rules obeyed by ordinary 
derivatives (e.g., the formulas for differentiating sums and products of func- 
tions, composite functions, etc.) are valid for variational derivatives. 


Remark. It is clear from the definition of the variational derivative 
that if A(x) is different from zero in a neighborhood of the point x, and if 
Ao is the area between the curve y = A(x) and the x-axis, then 


Ass sty +h Jb) = {2 +c}Ao, 
0 


B 
where « > 0 as both max [A(x)| and the length of the interval in which A(x) 
is nonvanishing go to zero. It follows that in terms of the variational 
derivative, the differential or variation of the functional J[y] at the point x, 
[for the curve y = y(x)] is given by the formula 


bJ 


s=5 


Ao. 


Z=Zo 





8. Invariance of Euler’s Equation 


Suppose that instead of the rectangular plane coordinates x and y, we 
introduce curvilinear coordinates uw and v, where 


x = x(u, v), 


I= yu, v), 


Then the curve given by the equation y = y(x) in the xy-plane corresponds 
to the curve given by some equation 


Xu Xp 


# 0. 35 
Yu Yo e) 








v = v(u) 


18 Ac can also be regarded as the area between the curves y = y(x) and y = y(x) + A(x). 
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in the wv-plane. When we make the change of variables (35), the functional 


6 
Jb] = [Fey y) ax 


goes into the functional 
Jafo] = fF [Cu 0), yu 0), 222) (xy + x0") 


= : Fy(u, v, v’) du, 
where . 
F,(u, v, v') = F [xt v), (us v), Yat We] (x, + xy’). 


We now show that if y = y(x) satisfies the Euler equation 


OF d OF 
Dy dea 0 (36) 
corresponding to the original functional J[y], then v = v(u) satisfies the 
Euler equation 


<1 5 F}=0 (37) 


corresponding to the new functional J,{v]. To prove this, we use the concept 
of the variational derivative, introduced in the preceding section. Let Ac 
denote the area bounded by the curves y = y(x) and y = p(x) + A(x), and 
let Ac, denote the area bounded by the corresponding curves v = v(w) and 
v = v(u) + 7(u) in the uv-plane. By the standard formula for the trans- 
formation of areas, the limit as Ac, Ac, — 0 of the ratio Ac/Ac, approaches 
the Jacobian 

Xu Xy 
Yu Vv 
which by hypothesis is nonzero. Thus, if 


m Jy +h) — Jy] _ 9 
Aco > 








aa 
then 
lim J,{v + y] - J, [v] 
4a,;>+0 Ao, 
as well. It follows that v(u) satisfies (37) if y(x) satisfies (36). In other 
words, whether or not a curve is an extremal is a property which is independent 
of the choice of the coordinate system. 

In solving Euler’s equation, changes of variables can often be used to 
advantage. Because of the invariance property just proved, the change of 
variables can be made directly in the integral representing the functional 
rather than in Euler’s equation, and we can then write Euler’s equation for the 
new integral. 


=0 
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Example. Suppose we are looking for the extremals of the functional 
Jin = [" VP +P? dp, (38) 
@o 


where r = r(p). The corresponding Euler equation has the form 
r d r 
Vet? dpVeqra 
The change of variables 
x =rcosg, y=rsing 


transforms (38) into an integral of the form 
[0 vI+y? a, 
Zo 
which has the Euler equation 


with general solution 
y=axt B. 
Therefore, the solution of (38) is 


rsing = arcosg + f. 


PROBLEMS 


J. Use the method of finite differences (Sec. 1) to find the shortest plane curve 
joining two points A and B. 


2. A set.@ in a normed linear space @ is said to be convex if A contains all 
elements of the form ax + By, where a, 2 0,a + @ = I, provided that #4 
contains x and y. Prove that the set of all elements xe satisfying the 
inequality ||x — xol| < c, where xp is a fixed element of Zand c > 0, is convex. 


3. Show that the set Ga, 5) of all continuous functions defined on the 
interval [a, 6], equipped with the norm 


b 1/2 
Io ={f lv@op ax} 
forms a normed linear space. 


4. An infinite sequence of elements }:, yo, ... of elements of a normed 
linear space Z& is called a Cauchy sequence (or fundamental sequence) if, given 
anye > 0, thereexists an integer N = N(e)such that ||y, — yall < ©, provided 
that m > N,n > N. A normed linear space & is said to be complete if every 
Cauchy sequence in @ converges to some element in @. Prove that the space 
€(a, b) introduced in the preceding problem is not complete, but that the space 
€(a, b) introduced in Sec. 2 is complete. 


Comment. See e.g., G. E. Shilov, op. cit., p. 249. 
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5. Prove that any norm defined on a linear space & is a continuous functional 
on &. 


6. Suppose the norm of the space &,(a, 6) is defined as 


lyl = max {|y@)], 1’@)],---, YP), 
a<cr<d 
instead of 
n 
Iyl = > max [yl 
f=0 a<r<d 


asonp.7. Prove that any functional on 9,(a, 6) which is continuous with 
respect to one of these norms is continuous with respect to the other. 


7. Let J[y] be the arc-length functional, defined for all ye Z,(a, 6). Show 


that J[y] is lower semicontinuous with respect to the norm of the space 
€(a, 6). 


Comment. As remarked in footnote 5, p. 8, J[y] is not continuous with 
respect to the norm of @(a, 6). 


8. Let p[h] be a linear functional defined on a normed linear space #. Prove 
that if p[hk] is continuous for A = 0, it is continuous for all he &. 


9. Prove that a linear functional [hk] cannot have an extremum unless 
elk] = 0. 


10. Prove that if two linear functionals 9[h] and $[h] defined on the same 
space vanish on the same set of elements, then 9[h] = Ad[A], where A is a 
constant. 


11. Show that constants co and c, can always be chosen satisfying the 
conditions (7) used to prove Lemma 3, p. 10. 


12. Prove that the square of a differentiable functional is differentiable, and 
write a formula for its differential (variation). 


13. Prove that if two differentiable functionals defined on the same normed 
linear space have the same differential at every point of the space, then they 
differ by a constant. 


14. Analyze the variational problems corresponding to the following func- 
tionals, where in each case »(0) = 0, (1) = 1: 


1 1 1 

a) i y’ dx; b) I yy’ dx; c) J xyy’ dx. 
i) i) Oo 

15. Find the extremals of the following functionals: 

b > y’2 

a) \ (y? + y? — 2ysin x) dx; b) I ye ax; 
& b 

c) i) (y? — y’? — 2y cosh x) dx; d) i) (y? + y’? + 2ye?) dx; 
o 

e) (y? — y? — 2ysin x) dx. 


Ans. b) y = Cix* + Ca; d) y = 4xe7 + Cye7 + Coe™7. 
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16. Prove the uniqueness part of Bernstein’s theorem (p. 16). 


Hint. Let A(x) = 92(x) — 9:(x), where ¢:(x) and ¢2(x) are two solutions 
of (15), write an expression for A*(x) and use the condition F,(x, y, y’) > k. 


17. Prove that one and only one extremal of each of the functionals 
fe-2(y2 — 1) dx, So? + y'tan-ty’ —Invl + y?) dx 
passes through any two points of the plane with different abscissas. 


Hint. Apply Bernstein’s theorem. 


18. Find the general solution of the Euler equation corresponding to the 
functional 


Ji) = [ vTF? ae, 


and investigate the special cases f(x) = vx and f(x) = x. 
Comment. The case f(x) = 1/x is treated in Example 1, p. 19. 


19. Find all minimal surfaces whose equations have the form z = 9(x) + $()). 
cos aly — Yo) 


Ans, z= Ax + By + C, et@-29) = 
cos a(x — Xp) 


20. Which curve minimizes the integral 
1 
i (ty? + yy’ + y’ + y) dx, 
when the values of y are not specified at the end points? 
Ans. y = x? - 3x + 1). 


21. Calculate the variational derivative at the point x, of the quadratic 
functional 


Ty = [f° KG, Dvr ds dt 
22. Find the extremals of the functional 
[ VRE PR VTS PF ae, 
Hint. Use polar coordinates. 


Ans. x* cosa + 2xy sin « — y? cos a = BP, where a and @ are constants. 


Z 


FURTHER GENERALIZATIONS 


In this chapter, we consider some further generalizations of the simplest 
variational problem. These include variational problems in spaces of dimen- 
sion greater than two (Sec. 9), problems in parametric form (Sec. 10), 
problems involving higher derivatives (Sec. 11), and problems with subsidiary 
conditions (Sec. 12). 


9. The Fixed End Point Problem for n Unknown Functions 


Let F(x, ¥1,---; Yn» Z1)--+» Zn) be a function with continuous first and 
second (partial) derivatives with respect to all its arguments. Consider 
the problem of finding necessary conditions for an extremum of a functional 
of the form 


b 
ITV - + +s Yal = I F(X, Vis + +s Yas Yaa ++ +s Va) aX, (1) 


which depends on n continuously differentiable functions y,(x),..., Ya(x) 
satisfying the boundary conditions 


ya =A, w(b)=B (= 1,...,0). (2) 
In other words, we are looking for an extremum of the functional (1) defined 
on the set of the set of smooth curves joining two fixed points in (7 + 1)- 
dimensional Euclidean space @,,,. The problem of finding geodesics, i.e., 
shortest curves joining two points of some manifold, is of this type. The 
same kind of problem arises in geometric optics, in finding the paths along 
which light rays propagate in an inhomogeneous medium. In fact, according 
to Fermat’s principle, light goes from a point Py to a point P, along the 


path for which the transit time is the smallest. 
34 
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To find necessary conditions for the functional (1) to have an extremum, 
we first calculate its variation. Suppose we replace each y,(x) by a “varied” 
function y(x) + A(x). By the variation 8J of the functional J[}1,..., yn], 
we mean the expression which is linear in A, hj (i = 1,...,2) and differs 
from the increment 


AJ = J[yy + Ay. -s Yn + Aa) — JI. Val 


by a quantity of order higher than | relative to /,, A, @ = 1,..., 2). Since 
both yx) and y,(x) + A(x) satisfy the boundary conditions (2), for each i, 
it is clear that 

h(a) = h{b) = 0 Gi = 1,...,n). 


We now use Taylor’s theorem, obtaining 
b 
AJ = [ [Fx 54 +A Yi + hi...) dx — F(x)... YY.) dx 
do 2 
= f > (FyAy + Fyhi) dx +++, 
@ i=l 


where the dots denote terms of order higher than 1 relative to A, hj 
(§=1,...,”). The last integral on the right represents the principal 
linear part of the increment AJ, and hence the variation of J[y,,..., Ya] is 


b n 
Mea i) > uly + Fy hd dx. 
Lace Rees 


Since all the increments Ax) are independent, we can choose one of them 
quite arbitrarily (as long as the boundary conditions are satisfied), setting 
all the others equal to zero. Therefore, the necessary condition 5J = 0 for 
an extremum implies 


[ (Fh, + Fyhidx=0 (i= 1,...,n). 
Using Lemma 4 of Sec. 3.1, we obtain the following system of Euler 
equations : 
=0 @ = 1,...,n). (3) 
Since (3) is a system of second-order differential equations, its general 


solution contains 2 arbitrary constants, which are determined from the 
boundary conditions (2). Thus, we have proved the following 


THEOREM. A necessary condition for the curve 
Ye = yi(x) (Gi = 1,...,n) 
to be an extremal of the functional 
b 
i; F(X, Vi, -- +) Yao Vio-- +s Yn) aX 


is that the functions yx) satisfy the Euler equations (3). 
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Remark 1. We have just shown how to find a well-defined system of 
Euler equations (3) for every functional of the form (1). However, two 
different integrands F can lead to the same set of Euler equations. In fact, 


let 
® = P(x, yi, - . +s Yn) 


be any twice differentiable function, and let 


oO 2. a 
¥ x, atee9 Sno ae A =— 4+ pital a 4 
(x, 1 Yn Vi Yn) ax Pa Dy, YW (4) 


Then we find at once by direct calculation that 


dy dx \ay) 
and hence the functionals 
b 
[ FG5 din Das Dine Ye) dx () 


and 
b 
i [F(X 15s Yay Vas + + +> Vad + P(X, Vis. es Yao Yar a Vad] dx (6) 


lead to the same system of Euler equations. 
Given any curve y, = y,(x), the function (4) is just the derivative 


d 
ax ® [x, yx(x), sees Yn(x)]. 
Therefore, the integral 


b , ; > d® 
I Hx, Vas +s Yas Vis ++ +> Ya) AX = [ ao 


takes the same value along all curves satisfying the boundary conditions (2). 
In other words, the functionals (5) and (6), defined on the class of functions 
satisfying (2), differ only by a constant. In particular, we can choose ® 
in such a way that this constant vanishes (but ¥ # 0). 


Remark 2. Two functionals are said to be equivalent if they have the 
same extremals. According to Remark 1, two functionals of the form (1) 
are equivalent if their integrands differ by a function of the form (4). It is 
also clear that two functionals of this form are equivalent if their integrands 
differ by a constant factor c #0. More generally, the functional (5) is 
equivalent to the functional (6) with F replaced by cF. 


Example 1. Propagation of light in an inhomogeneous medium. Suppose 
that three-dimensional space is filled with an optically inhomogeneous 
medium, such that the velocity of propagation of light at each point is some 
function v(x, y, z) of the coordinates of the point. According to Fermat’s 
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principle (see p. 34), light goes from one point to another along the curve 
for which the transit time of the light is the smallest. If the curve joining 
two points A and B is specified by the equations 


y=YWxX) 2 = 2(x), 


the time it takes light to traverse the curve equals 


r Lye ee 
e  —- u(x, y, Z) ; 


Writing the system of Euler equations for this functional, i.e., 


Ae le hele er 
oy v? aX yV1 + yy? 472 
de VI + y+ 27 od z’ a 
dz v? aX ypV1 + yy? 4722” 


we obtain the differential equations for the curves along which the light 
propagates. 


Example 2. Geodesics. Suppose we have a surface o specified by a vector 
equation? 


r = ry, v). (7) 


The shortest curve lying on o and connecting two points of a is called the 
geodesic connecting the two points. Clearly, the equations for the geodesics 
of o are the Euler equations of the corresponding variational problem, i.e., 
the problem of finding the minimum distance (measured along o) between 
two points of o. 

A curve lying on the surface (7) can be specified by the equations 


u= u(t), v = v(t). 


The arc length between the points corresponding to the values rt, and ft, 
of the parameter ¢ equals 


SO er a ne 
J[u, v] = I VEU? + 2Fu'v' + Gu? dt, (8) 


where E, F and G are the coefficients of the first fundamental (quadratic) 
form of the surface (7), i-e.,? 


E=r,"%,, F=r,1r,, G =r,-F,. 


1 Here, vectors are indicated by boldface letters, and a-b denotes the scalar product 
of the vectors a and b. 
2See D. V. Widder, op. cit., p. 110. 
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Writing the Euler equations for the functional (8), we obtain 


E,u? + 2Fyw'v' + Gw?  d 2(Eu' + Fv’) aig 
VEu? + 2Fu'v’ + Gv? 9 dt VEu? + 2Fu'v' + Gv? ; 
Ew? + 2Fyu'o' + Gy? d (Fu + Gv’) 


VEu? + 2Fuv' + Gv? 4 VEw? + 2Fu’ + Gv? 


As a very simple illustration of these considerations, we now find the 
geodesics of the circular cylinder 


r = (acos 9, asin 9, z), (9) 


where the variables p and z play the role of the parameters u and v. Since 
the coefficients of the first fundamental form of the cylinder (9) are 
E = a’, F=0, G=1, 
the geodesics of the cylinder have the equations 
@ OW eg: he «= 
dt Jap’? +72 7° dt Vat? 472” 


1.e., 
, 


a’q’ Zz 


sa =, aa =H C 
Vegttz? " Vaetpze 
Dividing the second of these equations by the first, we obtain 


dz _ 
do = C1, 
which has the solution 
Z= (9+ Ca, 


representing a two-parameter family of helical lines lying on the cylinder (9). 

The concept of a geodesic can be defined not only for surfaces, but also 
for higher-dimensional manifolds. Clearly, finding the geodesics of an 
n-dimensional manifold reduces to solving a variational problem for a 
functional depending on n functions. 


10. Variational Problems in Parametric Form 


So far, we have considered functionals of curves given by explicit equations, 
e.g., by equations of the form 


y = Wx) (10) 


in the two-dimensional case. However, it is often more convenient to 
consider functionals of curves given in parametric form, and in fact we have 
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already encountered this case in Example 2 of the preceding section (involving 
geodesics on a surface). Moreover, in problems involving closed curves 
(like the isoperimetric problem mentioned on p. 3), it is usually impossible 
to get along without representing the curves in parametric form. Thus, 
in this section, we extend our previous results to the case where the curves 
are given parametrically, confining ourselves to the simplest variational 
problem. 
Suppose that in the functional 


[P FG, yy) dx, (1) 


we wish to regard the argument y as a curve which is given in parametric 
form, rather than in the form (10). Then (11) can be written as 


if F [x, ye), 22 X(t) dt = [ D(x, y, x, p) dt (12) 
to x(t) to 
(where the overdot denotes differentiation with respect to f), ie., as a 
functional depending on two unknown functions x(t) and y(t). The 
function ® appearing in the right-hand side of (12) does not involve ¢ 
explicitly, and is positive-homogeneous of degree 1 in X(t) and y(t), which 
means that 
D(x, y, AX, AY) = AD(X, y, %, J) (13) 

for every 4 > 0.3 

Conversely, let 


f° OG, », & 9) at 
to 


be a functional whose integrand ® does not involve ¢ explicitly and is positive- 
homogeneous of degree 1 in X and y. We now show that the value of such 
a functional depends only on the curve in the xy-plane defined by the para- 
metric equations x = x(t), y = y(t), and not on the functions x(t), y(t) 
themselves, i.e., that if we go from ¢ to some new parameter t by setting 
t= 1(t), 
where dt/dt > 0 and the interval [to, 4,] goes into [t», t,], then 
ty dx dy fy ar 
ik © (x, n> 2) dx = [ * O(x, »5 5% 9) dt 

3 The example of the arc-length functional 

ie V% +5 dt, 

to 


whose value does not depend on the direction in which the curve x = x(t), y = y(t) is 
traversed, shows why (13) does not hold for 4 < 0. 
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In fact, since ® is positive-homogeneous of degree 1 in x and J, it follows 
that 


wy dx dy _ oft .dt .dt 
[Eo (xx BP) de = ["0(x 2 BIZ) ae 
"1 . . at = ty es 
=[" (x,y, I) Eade = | @(x, y, x, 9) dt, 


as asserted. Thus, we have proved the following 


THEOREM. A necessary and sufficient condition for the functional 
ty rane 
) D(t, x, y, X, 9) dt 
‘0 


to depend only on the curve in the xy-plane defined by the parametric 

equations x = x(t), y = y(t) and not on the choice of the parametric 

representation of the curve, is that the integrand D should not involve 

t explicitly and should be a positive-homogeneous function of degree \ in 

x and y. 

Now, suppose some parameterization of the curve y = y(x) reduces the 
functional (11) to the form 


ty *) 5 ou ty ee 
f F(x, v2) eat {. D(x, y, %, J) dt. (14) 


The variational problem for the right-hand side of (14) leads to the pair of 
Euler equations 


d d 
®, — 7 92 = 9% ®, — 59s = 9, (15) 
which must be equivalent to the single Euler equation 
d 
F,— 5 Fy = 9, 


corresponding to the variational problem for the original functional (11). 
Hence, the equations (15) cannot be independent, and in fact it is easily 
verified that they are connected by the identity 


d d 
+(0, - $9.) + 5(0, - 59) 2) (16) 


We shall discuss this point further in Sec. 37.5. 


Il. Functionals Depending on Higher-Order Derivatives 


So far, we have considered functionals of the form 


b 
i; F(x, y, y’) dx, 
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depending on the function y(x) and its first derivative y’(x), or of the more 
general form 


b 
[ F(x, 1, - «+9 Dns Vis - . 9) dx, 


depending on several functions y,(x) and their first derivatives y(x). How- 
ever, many problems (e.g., in the theory of elasticity) involve functionals 
whose integrands contain not only y,(x) and y,(x), but also higher-order 
derivatives y;(x), y7(x),.... The method given above for finding extrema 
of functionals (in the context of necessary conditions for weak extrema) can 
be carried over to this more general case without essential changes. For sim- 
plicity, we confine ourselves to the case of a single unknown function y(x). 

Thus, let F(x, y, 21,..., Z,) be a function with continuous first and second 
(partial) derivatives with respect to all its arguments, and consider a 
functional of the form 


1d 
IDL = [FG yy, dee (17) 


Then we pose the following problem: Among all functions y(x) belonging to 
the space 2,(a, b) and satisfying the conditions 


ya) = Ap, y'(a) = Ay, vey y"" Ya) = Ay-a, (18) 
yb) = Bo, y'(b) = By, ..., »—D(b) = B,-1, 


find the function for which (17) has an extremum. To solve this problem, we 
start from the general result which states that a necessary condition for a 
functional J[y] to have an extremum is that its variation vanish (Theorem 2, 
p. 13). Thus, suppose we replace (x) by the ‘“‘varied” function (x) + A(x), 
where A(x), like y(x), belongs to Y,(a,6).4 By the variation 8J of the 
functional J[y], we mean the expression which is linear in A, h’,..., A™, 
and which differs from the increment 


AJ = J[y + A] - Jy] 


by a quantity of order higher than | relative to h, h’,...,A™. Since both 
y(x) and y(x) + A(x) satisfy the boundary conditions (18), it is clear that 


h(a) = h(a) = --- = h(a) = 0, 
h(b) = h'(b) = +++ = h™-%(b) = 0. a) 


Next, we use Taylor’s theorem, obtaining 
b 
AT = [ [Fay + hy + yy +h) — FO Y's YO] 
17) 
= [ (FA + Fyhl +--+ Fyoh) det --, 


* The increment A(x) is often called the variation of »(x). In problems involving 
“fixed end point conditions” like (18), we often write A(x) = d5y(x). 
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where the dots denote terms of order higher than | relative to A, h’,..., A™. 
The last integral on the right represents the principal linear part of the 
increment AJ, and hence the variation of J[y] is 


b 
BJ = [ (Fh + By hl +--+ + Fyoh™) dee. 
Therefore, the necessary condition 8J = 0 for an extremum implies that 
b 
i (Fh + Fyh! +--+ + Fyoh™) dx = 0. (20) 


Repeatedly integrating (20) by parts and using the boundary conditions (19), 
we find that 





[[_-#F Peiey —---+(-l1)* Zz Fyn] h(x)dx =0 = (21) 
al. 2akeo% oie @ aw”? 7 
for any function h which has n continuous derivatives and satisfies (19). It 
follows from an obvious generalization of Lemma | of Sec. 3.1 that 
d d? 

F, = ax F, + dx? 
a result again called Euler’s equation. Since (22) is a differential equation 
of order 2n, its general solution contains 2n arbitrary constants, which can 
be determined from the boundary conditions (18). 


Fy - + + (=I 





da” 
an Fu = 0, (22) 


Remark. This derivation of the Euler equation (22) is not completely 
rigorous, since the transition from (20) to (21) presupposes the existence 
of the derivatives 

d d? d”" 

ax Fy, ae Fy, cacy ax Fy. (23) 
However, by a somewhat more elaborate argument, it can be shown that 
(20) implies (22) without this additional hypothesis. In fact, the argument 
in question proves the existence of the derivatives (23), as in Lemma 4 of 
Sec. 3.1.5 


12. Variational Problems with Subsidiary Conditions 


12.1. The isoperimetric problem. In the simplest variational problem 
considered in Chapter |, the class of admissible curves was specified (apart 
from certain smoothness requirements) by conditions imposed on the end 
points of the curves. However, many applications of the calculus of varia- 
tions lead to problems in which not only boundary conditions, but also 


5 Of course, this argument is unnecessary if it is known in advance that F has contin- 
uous partial derivatives up to order 2 + 1 (with respect to all its arguments). 
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conditions of quite a different type known as subsidiary conditions (synony- 
mously, side conditions or constraints) are imposed on the admissible curves. 
As an example, we first consider the isoperimetric problem,® which can be 
stated as follows: Find the curve y = y(x) for which the functional 


b 
Jb = | Fey, »") dx (24) 
has an extremum, where the admissible curves satisfy the boundary conditions 


va)= A, Wb) = 8, 


and are such that another functional 


Kb = [Gey y) ae (25) 


takes a fixed value |. 

To solve this problem, we assume that the functions F and G defining 
the functionals (24) and (25) have continuous first and second derivatives in 
[a, b) for arbitrary values of y and y’. Then we have 


THEOREM 1.” Given the functional 


Jil = f° FG», ») ds 


let the admissible curves satisfy the conditions 
1) 
wa)= A,  y(6)=B,  Kl=J Gay,y)dx=1 (26) 


where K[y] is another functional, and let J{y] have an extremum for 
y = (x). Then, if y = y(x) is not an extremal of K[y], there exists a 
constant ) such that y = y(x) is an extremal of the functional 


‘i (F + 2G) dx, 


i.e., » = WX) satisfies the differential equation 


d d 
Fy - Fy +) (4, = Gy) = 0. (27) 


Proof. Let J[y] have an extremum for the curve y = p(x), subject to 
the conditions (26). We choose two points x, and xz in the interval 


® Originally, the isoperimetric problem referred to the following special problem 
(already mentioned on p. 3): Among all closed curves of a given length I, find the curve 
enclosing the greatest area. This explains the designation ‘‘isoperimetric’”’ = ‘‘ with the 
same perimeter.” 

7 The reader will easily recognize the analogy between this theorem and the familiar 
method of Lagrange multipliers for finding extrema of functions of several variables, 
subject to subsidiary conditions. See e.g., D. V. Widder, op. cit., Chap. 4, Sec. 5, espe- 
cially Theorem 5. 
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[a, 6], where x, is arbitrary and x, satisfies a condition to be stated below, 
but is otherwise arbitrary. Then we give y(x) an increment 8, y(x) 
+ 52x), where 3,)(x) is nonzero only in a neighborhood of x,, and 
32}(x) is nonzero only in a neighborhood of x,. (Concerning this 
notation, see footnote 4, p. 41.) Using variational derivatives, we can 
write the corresponding increment AJ of the functional J in the form 


oF } {Fe 
+e,+Ao, + <— 
gee 1 1 Sy 


AJ = <= 
b b 
Ao, = | 3, (x) dx, Ac, = ) 52 y(x) dx 








- < ex} Acs, (28) 


r=7q 


where 


and €;, €2 > 0 as Ao,, Ac, — 0 (see the Remark on p. 29). 
We now require that the “varied” curve 


y= y*(x) = WX) + 81x) + 82x) 
satisfy the condition 


K[y*] = K{y]. 
Writing AK in a form similar to (28), we obtain 
8G 
AK = K[y*] — Kly] = 455 
y z=2) (29) 





; 8G 
+ es} Ao, + {F 


where €}, €2 > 0 asAoc,,Ac,—>0. Next, we choose x2 to be a point for 
which 





+ es} Acs = 0, 
z=32o 


8G 


y #0. 


zreorg 





Such a point exists, since by hypothesis y = y(x) is not an extremal of 
the functional K. With this choice of x2, we can write the condition 
(29) in the form 

8G 
by 
8G 
Sy 


where e’-> 0 as Ao, > 0. Setting 





razr 
Ao, == eS 





+ e')Ao,, (30) 





r=Iq 


oF 
by t=%2 
Xr = 3G , 
dy 








zr=22 
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and substituting (30) into the formula (28) for AJ, we obtain 


oF 


AJ = yy 


tf 
Sag by 








} ao, + eAa,, (31) 
r=z) 

where « > 0 as Ao, ->0. This expression for AJ explicitly involves 
variational derivatives only at x = x,, and the increment A(x) is now 
just 8, y(x), since the ‘compensating increment” 8.y(x) has been taken 
into account automatically by using the condition AK = 0. Thus, the 
first term in the right-hand side of (31) is the principal linear part of AJ, 
i.e., the variation of the functional J at the point x, is 


8F 3 Age. 


dy 
Since a necessary condition for an extremum is that 5J = 0, and since 
Ao, is nonzero while x, is arbitrary, we finally have 


sJ = 








ema re 


SF 3G d d 
Bt ge he Riv t4(G - 5Gr) =0, 


which is precisely equation (27). This completes the proof of the 
theorem. 


To use Theorem | to solve a given isoperimetric problem, we first write 
the general solution of (27), which will contain two arbitrary constants in 
addition to the parameter A. We then determine these three quantities from 
the boundary conditions y(a) = A, »(b) = B and the subsidiary condition 
K{y] = 1. 

Everything just said generalizes immediately to the case of functionals 
depending on several functions ),,..., y, and subject to several subsidiary 
conditions of the form (25). In fact, suppose we are looking for an extremum 
of the functional 


Insc Iad = [FG Ite Iu Tin ee YO Ee (32) 
subject to the conditions 
y(@) =A, y(b)=B (= 1,..5n) (33) 
and 
[Gorrie Wernh G=1.. 4) 


In this case a necessary condition for an extremum is that 


ay, (+ >6) = fiz wrt >n6,)} =0 (=1,...,2). (35) 


The 2n arbitrary constants appearing in the solution of the system (35), 
and the values of the & parameters 2,,..., A,, sometimes called Lagrange 
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multipliers, are determined from the boundary conditions (33) and the 
subsidiary conditions (34). The proof of (35) is not essentially different 
from the proof of Theorem 1, and will not be given here. 


12.2. Finite subsidiary conditions. In the isoperimetric problem, the 
subsidiary conditions which must be satisfied by the functions y,,..., y, 
are of the form (34), i.e., they are specified by functionals. We now consider 
a problem of a different type, which can be stated as follows: Find the 
functions yx) for which the functional (32) has an extremum, where the 
admissible functions satisfy the boundary conditions 


yi(a) = A, y(b) = B, (= 1,...,n) 
and k “finite” subsidiary conditions (k < n) 


8%, Ye =O (f= ],..., 4). (36) 
In other words, the functional (32) is not considered for all curves satisfying 
the boundary conditions (33), but only for those which lie in the (n — k)- 
dimensional manifold defined by the system (36). 
For simplicity, we confine ourselves to the case n = 2,k = 1. Then we 
have 


THEOREM 2. Given the fictional 


t) 
Jtyz1= | FOsy 292) dx, (37) 
let the admissible curves lie on the surface 
g(x, ¥,z) = 0 (38) 


and satisfy the boundary conditions 
a) = A, Wb) = B,, 
2(a) = Ap, 2(b) = Bo, 
and moreover, let J[y] have an extremum for the curve 
y=Wx) Zz = 2(x). (40) 
Then, if g, and g,do not vanish simultaneously at any point of the surface 


(38), there exists a function (x) such that (40) is an extremal of the 
functional 


(39) 


[ + x00¢1 dx, 


i.e., satisfies the differential equations 


d 
Fy + dy — 7 Fy = 9, 


(41) 


F,+0.- ZF =0, 


Proof. As might be expected, the proof of this theorem closely 
resembles that of Theorem 1. Let J[y, z] have an extremum for the 
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curve (40), subject to the conditions (38) and (39), and let x, be an arbi- 
trary point of the interval [a, 5]. Then we give y(x) an increment Sy(x) 
and z(x) an increment 8z(x), where both Sy(x) and 8z(x) are nonzero 
only in a neighborhood [a, 8] of x;. Using variational derivatives, we 
can write the corresponding increment AJ of the functional J[y, z] in the 


form 
SF 
a= {5 


bd b 
Nees I Sx) dx, Acs = f 82(x) dx, 





+e} Ao, +{z] +e} Ao, (42) 
r=2) z t=2) 


where 


and €,, €2 > 0 as Ao,, Ac, > 0. 
We now require that the “varied” curve 


y = y*(x) = v(x) + Sx), oz = 2*(x) = 2(x) + 82(x) 
satisfy the condition ® 
a(x, y*, z*) = 0. 


In view of (38), this means that 


b b 
0 = | [ex y* 24) — ate», 2))dx = | (6, By + 8.32) dx 


(43) 
= {Sy lens, + e4} Ao, ae {gzlz-7 + eo} Aono, 


where €, €2 > 0 as Ac,, Ac, 0, and the overbar indicates that the 
corresponding derivatives are evaluated along certain intermediate curves. 
By hypothesis, either g,|,-:, OF 82|z:=2, is nonzero. If g.|,-,, # 0, we 
can write the condition (43) in the form 





Ao, = — ‘a + ef Ao, (44) 


where e’>0 as Ac, >0. Substituting (44) into the formula (42) for 


AJ, we obtain 
= (2 **) 
pers 8, 8z 


® The existence of admissible curves y = y*(x), z = z*(x) close to the original curve 
y = y(x), z = 2(x) follows from the implicit function theorem, which goes as follows: 
If the equation g(x, y, z) = 0 has asolution for x = xo, y = yo, Z = 2o, if g(x, », 2) and its 
first derivatives are continuous in a neighborhood of (x0, yo, Zo), and if g{Xo, Yo, Zo.) # 0, 
then g(x, y, z) = 0 defines a unique function z(x, y) which is continuous and differ- 
entiable with respect to x and y in a neighborhood of (xo, yo) and satisfies the condition 
z(Xo, Yo) = Zo. [There is an exactly analogous theorem for the case where 
&y(Xo0, Yo, 20.) # 0.) Thus, if g.{[x, y(x), z(x)] # 0 in a neighborhood of the point xo, 
we can change the curve y = y(x) to y = y*(x) in this neighborhood and then determine 
z*(x) from the relation z*(x) = z[x, y*(x)). 


SF 
AI = 15, 








} ao, + eAo,, 


a 
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where ¢ > 0 as Ac,->0. The first term in the right-hand side is the 
principal linear part of AJ, i.e., the variation of the functional J at the 


point x, is 
8, 8F 
Pe a) Me 


Since a necessary condition for an extremum is that 8/ = 0, and since 
Ao, is nonzero while x, is arbitrary, we finally have 


oF 
oJ = > 








SF 8, 8F _ d 8y d = 
Fg tp (te) a0 
or 
RoLe, F, 4 Fr, 
————— = —__. (45) 
8y 82 


Along the curve y = y(x), z = 2(x), the common value of the ratios 
(45) is some function of x. If we denote this function by —A(x), then 
(45) reduces to precisely the system (41). This completes the proof of 
the theorem. 


Remark 1. We note without proof that Theorem 2 remains valid when 
the class of admissible curves consists of smooth space curves satisfying the 
differential equation® 


g(x, Vr 2, y', z’) = 0. (46) 


More precisely, if the functional J has an extremum for a curve y, subject 
to the condition (46), and if the derivatives g,-, g, do not vanish simul- 
taneously along y, then there exists a function A(x) such that y is an integral 
curve of the system 


where 
® = F+G. 


Remark 2. In acertain sense, we can consider a variational problem with 
a finite subsidiary condition to be a limiting case of an isoperimetric problem. 
In fact, if we assume that the condition (38) does not hold everywhere, but 
only at some fixed point 


g(%1, y, Zz) = 0, 


we obtain a condition whose left-hand side can be regarded as a functional 
of y and z, i.e., a condition of the type appearing in the isoperimetric problem. 


° In mechanics, conditions like (46), which contain derivatives, are called nonholonomic 
constraints, and conditions like (38) are called holonomic constraints. 
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Thus, the condition (38) can be regarded as an infinite set of conditions, 
each of which is a functional. As we have seen, in the isoperimetric problem 
the number of Lagrange multipliers 44,..., A,, equals the number of con- 
ditions of constraint, In the same way, the function A(x) appearing in the 
problem with a finite subsidiary condition can be interpreted as a ‘‘ Lagrange 
multiplier for each point x.” 


Example 1. Among all curves of length | in the upper half-plane passing 
through the points (—a,0) and (a, 0), find the one which together with the 
interval [—a, a] encloses the largest area. We are looking for the function 
y = (x) for which the integral 


JD] = fo ya 
takes the largest value subject to the conditions 
X—a) = Wa) =0, Kb) =f) V+ 9% dx = 1. 


Thus, we are dealing with an isoperimetric problem. Using Theorem 1, 
we form the functional 


J[y] + AK[y] = i (y + AV1 + y”) dx, 


and write the corresponding Euler equation 


d y’ 
14+,A——==— = 0, 
dx V/] + y? 
which implies 
y' 
X + Am = CC). 47 
V1+y? , “0 


Integrating (47), we obtain the equation 
(x — Cy)? + (vy — C,)? = 2»? 


of a family of circles. The values of C,, C, and A are then determined from 
the conditions 
W-a)=ya)=0, Ky) =! 

Example 2. Among all curves lying on the sphere x? + y? + z? = a? and 
passing through two given points (Xo, Yo, Zo) and (X41, Yi, 21), find the one which 
has the least length. The length of the curve y = y(x), z = 2(x) is given by 
the integral 


i VI + y? + Zz? dx. 
Zo 


Using Theorem 2, we form the auxiliary functional 


Po VT 4 y? FZ? + A? + y? + 2) dx, 
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and write the corresponding Euler equations 


d y’ 
2 - ETS To 
2en(x) — 4 us = 0. 


dx V/1 + y? 42% 


Solving these equations, we obtain a family of curves depending on four 
constants, whose values are determined from the boundary conditions 


YW%o) = Yo» Ys) = Yas 
2(Xo) = Zo, 2(%1) = 21. 


Remark. As is familiar from elementary analysis, in finding an extremum 
of a function of n variables subject to k constraints (kK < n), we can use the 
constraints to express k variables in terms of the other n — k variables. 
In this way, the problem is reduced to that of finding an unconstrained 
extremum of a function of n — k variables, i.e., an extremum subject to no 
subsidiary conditions. The situation is the same in the calculus of variations. 
For example, the problem of finding geodesics on a given surface can be 
regarded as a problem subject to a constraint, as in Example 2 of this section. 
On the other hand, if we express the coordinates x, y and z as functions of 
two parameters, we can reduce the problem to that of finding an unconstrained 
extremum, as in Example 2 of Sec. 9. 


PROBLEMS 
1. Find the extremals of the functional 
{2 
Jin 21 = [Cy + 2? + 292) de, 


subject to the boundary conditions 
x0) = 0, HWr/2)=1, 200)=0, x(n/2) = 1. 


2. Find the extremals of the fixed end point problems corresponding to the 
following functionals: 


a) ie (py? + 2 4+ y'z') dx; 
b) [7 @yz — 298 + y? ~ 2°) dr, 
3. Find the extremals of a functional of the form 
[? Fo, 2) de, 
given that F,-yF.-.- — (F,2)? # 0 for x9 < x < x. 


Ans. A family of straight lines in three dimensions. 
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4. State and prove the generalization of Theorem 3 of Sec. 4.1 for functionals 
of the form 


b 
J F(x, Vi Cae Yn Vu sees Yn) dx. 
Hint. Thecondition F,, # Ois replaced by the condition det ||Fy;iy;,|_ # 0. 


5. What is the condition for a functional of the form 


ty ‘ ' 
(E F(t, Yay ++) ny Y1y + + Yn) at, 


depending on an n-dimensional curve » = y(x), i= 1,...,, to be 
independent of the parameterization? 


6. Generalizing the definition of Sec. 10, we say that the function f(m, ..., xn) 
iS positive-homogeneous of degree k in X1,..., Xn if 


SOx. «225 Xn) = Mf (rr, «5 Xn) 


for every 2 > 0. Prove the following result, known as Euler’s theorem: 
If f(x;,..., Xn) is continuously differentiable and positive-homogeneous of 
degree «, then 


7. State and prove the converse of Euler’s theorem. 
8. Verify formula (16) of Sec. (10). 
Hint. Use Euler’s theorem. 


9. Prove that the Euler equations (15) of the variational problem in para- 
metric form can be written as 


Ory — Pry + (XY — Xy)P, = 0, (a) 


where ®, is a positive-homogeneous function of degree —3 satisfying the 
relations 
Oy = yO, G1, = —xy®,, yy = X7®. 


Comment. Equation (a) is known as Weierstrass form of the Euler 
equations. It can also be written as 


1 ® - 9%, 
p OG + yp? 


where p is the radius of curvature of the extremal. 


10. Prove that Weierstrass’ form of the Euler equations is invariant under 
parameter changes ¢ = ¢(t), dt/dz > 0. 


11. Find the extremals of the functional 
1 
b= Ja +9) da, 


subject to the boundary conditions 
xO=0 yYO=Hl, wO=H1, YO=l. 
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12. Find the extremals of the functional 

m2 

Ji = [08 =»? + x) dx, 
subject to the boundary conditions 
yO= 1, y(O)=0, Ywr/2)=0, y(r/2) =1. 
13. Show that the Euler equation of the functional 
be F(x, y, »’, ¥") dx 

has the first integral 


d 
Fy - 5. 


if the integrand does not depend on y, and the first integral 


F,- = const 


F- y(F - # Fy) — y’F,” = const 
if the integrand does not depend on x. 


14. Find the curve joining the points (0, 0) and (1, 0) for which the integral 


mL 
| y”? dx 
oO 
iS a minimum if 

a) y'(0) = a, y'(1) = b; 

b) No other conditions are prescribed. 
15. Supply the details of the argument mentioned in the remark on p. 42. 


16. By direct calculation, without recourse to variational methods, prove 
that the isosceles triangle has the greatest area among all triangles with a 
given base line and a given perimeter. 


Hint. All the triangles in question have the given base line and a vertex 
lying on a certain ellipse. 


17. Find the equilibrium position of a heavy flexible inextensible cord of 
length /, fastened at its ends. 


Hint. Minimize the ordinate of the center of gravity of the cord. By 
making a suitable change of variables, reduce the problem to Example 2 of 
Sec. 4.2. 


18. Find the extremals of the functional 
Ib = [07 + 2) dx, 
subject to the conditions 
0) =0, wt=0,  [ y2dx = 2. 


19. Suppose an airplane with fixed air speed vo makes a flight lasting T 
seconds. Along what closed curve should it fly if this curve is to enclose 
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the greatest area? It is assumed that the wind velocity has constant direction 
and magnitude a < vo. 

Ans. An ellipse whose major axis is perpendicular to the wind velocity 
and whose eccentricity is a/vo. The velocity of the airplane is perpendicular 
to the radius vector of the ellipse. 


20. Given two points A and B in the xy-plane, let y be a fixed curve joining 
them. Among all curves of length / joining A and B, find the curve which 
together with y encloses the greatest area. 


21. Generalizing the preceding problem, suppose the xy-plane is covered by 
a mass distribution with continuous density u(x, y). As before, let A and B 
be two points in the plane, and let y be a fixed curve joining them. Among 
all curves of length / joining A and B, find the curve which together with y 
bounds the region of greatest mass. 


Hint. Introduce the auxiliary function V(x, y) = J u(x, y) dx. Then use 
Green’s theorem and Weierstrass’ form of the Euler equations. 


22. Among all curves joining a given point (0, 6) on the y-axis to a point on 
the x-axis and enclosing a given area S together with the x-axis, find the curve 
which generates the least area when rotated about the x-axis. 

Ans. The line 


where ab = 28. 


3 


THE GENERAL VARIATION 
OF A FUNCTIONAL 


13. Derivation of the Basic Formula 


In this section, we derive the general formula for the variation of 
a functional of the form 


Ia eee Val =P” FQ Vaso Yaw Yas ooo Ye) aH, (1) 
Io 


beginning with the case where (1) depends on a single function y and hence 
reduces to 


Ji = J* FG, yy) ax 2) 


We assume that all admissible curves are smooth, but, departing from our 
previous hypothesis, we assume that the end points of the curves for which 
(2) is defined can move in an arbitrary way. By the distance between two 
curves y = y(x) and y = y*(x) is meant the quantity 


e(y, ¥*) = max |y — y*| + max |y’ — y*’| + p(Po, Ps) + (Pi, Pi), (3) 


where Po, P* denote the left-hand end points of the curves y = y(x), 
y = y*(x), respectively, and P,, P* denote their right-hand end points.} 
In general, the functions y and )* are defined on different intervals J and /*. 
Thus, in order for (3) to make sense, we have to extend y and y* onto some 
interval containing both Jand [*. For example, this can be done by drawing 
tangents to the curves at their end points, as shown in Figure 4. 


1 In the right-hand side of (3), p denotes the ordinary Euclidean distance. 
54 
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Now let y = y(x) and y = y*(x) be two neighboring curves, in the sense 
of the distance (3), and let? 
A(x) = y*(x) — y(x). 
Po = (Xo, Yo): P, = (x1, ¥1) 


denote the end points of the curve y = y(x), while the end points of the 
curve y = y*(x) = y(x) + A(x) are denoted by 


PE = (Xo + 8x0, Yo + S¥o), Pi = (41 + 8x1, ¥1 + 8)4). 


Moreover, let 





FiGure 4 


The corresponding variation SJ of the functional J[y] is defined as the 
expression which is linear in A, h’, 8x9, 5yo, 5x;, 8y,, and which differs from 
the increment 

AJ = J[y + A] - Jp] 


by a quantity of order higher than | relative to p(y, y + A). Since?® 


z, +62, ta 
AJ = F(x yth y + h')dx - | F(x, y, y’) dx 


Io +520 
= im [F(x y + hy’ +h’) — F(x, y, y’)] dx (4) 


Ipot 


zr, +62, F ; 625 
+f F(x y thy + h’)dx — | F(x y + hy +h’) dx, 


it follows by using Taylor’s theorem and letting the symbol ~ denote equality 
except for terms of order higher than | relative to p(y, y + A) that 


AJ ~ [Fale ys yh + Fees ys DMT dx 
+ F(X, y,y')ea2 8%1 — FOV) 2=20 8X0 
-{" [F. Z afr] h(x) dx + Flrar, 31 + Fyhlenn, 
= Fleas 8%0 — Fyhleasos 


2 Note that it is no longer appropriate to write A(x) = 5y(x), as in footnote 4, p. 41. 
In fact, in the more precise notation of Sec. 37, A(x) = 5y(x). 

3 Recall that we have agreed to extend »(x) and y*(x) linearly onto the interval 
[Xo, X1 + 5x], so that all integrals in the right-hand side of (4) are meaningful. 
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where the term containing /’ has been integrated by parts. However, it is 
clear from Figure 4 that 

h(xo) ~ Sy — y'(Xo) 8X0; 

h(x) ~ 8y1 — y'(%1) 8x1, 


where ~ has the same meaning as before, and hence 


ar = [F. -£ Fy] Wx) dx + Fylees, 1 + (F — Fry Yeon, 8% 
To 


; (5) 
ars Flees 3¥o — (F _ Fy) le=sy 8X05 


or more concisely, 


[- = a] h(x) dx + Fy by 7 1 4 (F — Fyy’) 8x] ni 


Zo =Io 


gee 


Zo 


where we define 
dx|,-,, = 8x, Sy|2-2, = 3% (i = 0, 1). 


This is the basic formula for the general variation of the functional J[y]. 
If the end points of the admissible curves are constrained to lie on the straight 
lines x = Xo, X = X,, as in the simple variable end point problem considered 
in Sec. 6, then xp = 5x, = 0, while, in the case of the fixed end point 
problem, 8x, = 8x, = Oand Sy) = Sy, = 0. 

Next, we return to the more general functional (1), which depends on 
n functions y,,...,; Yn. Since any system of m functions can be interpreted 
as a curve in (» + 1)-dimensional Euclidean space &,,,, we can regard (1) 
as defined on some set of curves in &,,,. Paralleling the treatment just 
given for m = 1, we now calculate the variation of the functional (1) when 
there are no restrictions on the end points of the admissible curves. As 
before, we write 


h(x) = yFQ) — v(x) = 1...) 
where for each /, the function y*(x) is close to y,(x) in the sense of the distance 
(3). Moreover, we let 
Po = (Xos V3, +++» Vado Py = (1, Yin. - «5 Ya) 
denote the end points of the curve y, = yx), i = 1,...,”, while the end 
points of the curve »y, = y#(x) = y(x) + A(x), i = 1,..., 7, are denoted by 


PF = (Xo + Sx, y? + Syf,.--, yn + SD), 
P# = (x1 + 3x1, yi + Syi,..., yh + SYA), 


and once more, we extend the functions y(x) and y#(x) linearly onto the 
interval [xo, x, + 5x,]. The corresponding variation 8J of the functional 
J[yi,---»¥n] is defined as the expression which is linear in 5x9, 5x, and all 


SEC. 13 GENERAL VARIATION OF A FUNCTIONAL 57 


the quantities /,, h;, v3, yi (i = 1,...,”), and which differs from the 


increment 
AJ = J[p1 + Ay. . es ¥n + Aa) — JO. dal 


by a quantity of order higher than | relative to 


Since 
z, +62, , : zy F 
AJ = ih F(x. + hy H+ hy ..)dx — | F(X... Ye Yonex 
9 + 520 to 
= [FGF MHF Mis) = FO Yo Dx 
, z, +62, P ; 
+ F(x, ...5¥ + hy Wi + Ay...) 


zy 


Zo + 619 , . 
~ { F(x... +h +My...) ax, 
To 


it follows by using Taylor’s theorem and letting the symbol ~ denote 
equality except for terms of order higher than | relative to the quantity (6) 


that 


Apa. > Fads + fa dx + Flo, 8x, — Flzo2, 3X0 
t= 


=[ > (F, _ 5 Fri) h(x) de + Flee 2, OX, + > Fal r= Zi 


4 F\s=25 5X0 . Fyhi|2=20) 
{=i 


where the terms containing /; have been integrated by parts. Just as in the 
case n = 1, we have 


» 


h(xo) ~ 8y4 — yilxo) 8X0, 
h(x) ~ 8y} — yilxy) 8x1, 




















and hence 
= [> (Fi — Fi) Ae ae 
+ > F,; dyi + (F- > yiF) 8x} 
{=1 r=2} i=1 Zee 
=> Fi = (F aS HF) 3x0. 
i=l r=Z0 i=l I= 20 
or more concisely, 
Ae d 
as = | > (4, - <4 Fy) h(x) dx 
n 5 r=2, = n ; 5 nae e (7) 
+ > Fy; Yi +(F > Ji Fy; x , 
i=1 Z=Z0 i=l I=I0 


where, as before, we define 
Sx|2_5, = 3x;, Miles, = dy} G = 0, 1). 
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This is the basic formula for the general variation of the functional 
IDs Yad 

We now write an even more concise formula for the variation (7), at 
the same time introducing some important new ideas, to be discussed in 
more detail in the next chapter. Let 


Di = Fy G = 1,...,n), (8) 
and suppose that the Jacobian 


Pr, ve -» Dn) Sy det lFuvl 


AV ~~ +> Yn) 
is nonzero.*’ Then we can solve the equations (8) for yj, ..., y;, as functions 
of the variables 
Xy Vis- ses Ynys Pris-- +> Pa (9) 


Next, we express the function F(x, ¥1,..-; Yao Yiy---» Yn) appearing in (1) 
in terms of a new function H(x, y1,..., Ya» Pi,-++; Pa) related to F by the 
formula 


H=-F+ > Hi —F+ > vip. 
i= i=1 

where the y, are regarded as functions of the variables (9). The function 
H is called the Hamiltonian (function) corresponding to the functional 
J[y1,.--; Yn]. In this way, we can make a local transformation (see footnote 
2, p. 68) from the “variables” x, y1,..., Yn» Yis--+>¥n F appearing in (1) 
to the new quantities x, y1,...,;¥ny»Pis--+>Pn» H, called the canonical 
variables (corresponding to the functional J[y,,..., ¥,]). In terms of the can- 
onical variables, we can write (7) in the form 





= ni dp, Me ety 
sJ = I. ps (4, ~ @) h(x) dx + (> pi dby, H 8x) ue 
Remark. Suppose the functional J[y,,..., ¥,] has an extremum (in a 
certain class of admissible curves) for some curve 
N=) G=1,...,9) (10) 


joining the points 


Po = (Xo, Y2,- + +s Vads Py = (%1, Yin. + +s Yad 
Then, since J[);, ..., ¥,] has an extremum for (10) compared toall admissible 
curves, it certainly has an extremum for (10) compared to all curves with 
fixed end points Po and P;. Therefore, (10) is an extremal, i.e., a solution 
of the Euler equations 


F,=0 ((=1,....2) 


* By det |la,.|| is meant the determinant of the matrix ||a,,||. 
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so that the integral in (7) vanishes, and we are left with the formula 





$J = [> F,; by, + (F = > HF i) Bx ‘ 5 (11) 
f=1 i=1 Zr=I9 
or in canonical variables 
87 = (> pd - Hx) | (12) 
i=1 z=20 





Thus, regardless of the boundary conditions defining our variable end point 
problem, the curve for which J[y,,..., y,] has an extremum must first be 
an extremal and then satisfy the condition that (11) or (12) vanish (see 
Problem 1, p. 63). 


14. End Points Lying on Two Given Curves or Surfaces 


The first two chapters of this book have been devoted mainly to fixed 
end point problems, where the boundary conditions require that all admissible 
curves have two given end points. The only exception is the simple variable 
end point problem considered in Sec. 6, where the end points of the admissible 
curves are free to move along two fixed straight lines parallel to the y-axis. 
We now consider a more general variable end point problem. To keep 
matters simple, we start with the case where there is only one unknown 
function. Our problem can be stated as follows: Among all smooth curves 
whose end points Py and P, lie on two given curves y = 9(x) and y = (x), 
find the curve for which the functional 


JD = [* Fe, y, vax 


has an extremum. For example, the problem of finding the distance between 
two plane curves is of this type, with 


F(x, yy) = V1 + y?. 


As shown in the preceding section, the general variation of the functional 
J[y]is given by formula (5). IfJ/[y] has an extremum for the curve y = y(x), 
then, as noted at the end of Sec. 13, this curve must first of all be an 
extremal, i.e., a solution of Euler’s equation. Hence, the integral in (5) 
vanishes and we have 


SJ= Fylrax dy, + (F = Fyy 2-7 8x, 
= Fy-|r=25 8Yo _ (F a, Fy-y)|2= 25 3X0, 


which must vanish if J[y] is to have an extremum for y = y(x). 
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Next, we observe that according to Figure 5, 
8¥o = [9'(x) + €o] 8x0, dy. = [’Or) + €1) 8x1, 
where £, > 0 as 5x, > 0, and c«, > 0as 8x,->0. Thus, in the present case, 
the condition J = 0 becomes 
sJ = (Fyy’ + F- Bee) | een 8x, — (Fy9" + F- y'Fy)|2=20 8x = 0, 
(13) 
since 8J contains only terms of the first order in 5xy and 8x,. Since the 
increments 5x, and 8x, are independent, (13) implies the boundary conditions 
(Fy 9’ + F- VEY leas, = 0, 
(Fy + F- y'Fy)\e-2 0, 


or 
[F + (9 — y')Fy]lz=2 = 9, 
[F + (y' _ Y)Fylr=2, = 0, 


called the transversality conditions. The curve y = y(x) satisfying these 
conditions is said to be a transversal of the curves y = (x) and y = (x). 
Thus, to solve this kind of variable 
end point problem, we must first 
solve Euler’s equation 


Fy - 4k, = 0, (14) 

and then use the transversality 

conditions to determine the values 

of the two arbitrary constants 

FIGURE 5 appearing in the general solution 

of (14). 

In solving variational problems, we often encounter functionals of the 

form 





x,+ 8x, * 


[fe VT 4 y? ax. (15) 
Zo 

For such functionals, the transversality conditions have a particularly simple 
appearance. In fact, in this case, 


ri 'F 
Fy = {ON FER = a 





= Ty? 


so that the transversality conditions become 


: ‘ 1 + y'o’)F 
F+ - yy = SAE =o, 
(C4 VF 4 


F+(y —y/)F, lt y? 
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It follows that 


at the left-hand end point, while 


; 1 
ym-¥ 

at the right-hand end point, i.e., for functionals of the form (15), trans- 
versality reduces to orthogonality. 

The same kind of variable end point problem can be posed for functionals 
depending on several functions. For example, consider the following 
problem: Among all smooth curves whose end points lie on two given surfaces 
x = 9(y, z) and x = (y, z) find the curve for which the functional 


Jin z)= "Fs y zy, 2) dex 
Zo 


hasan extremum. Setting n = 2 in formula (7) of the preceding section, we 
obtain the general variation of the functional J[y, z]. By the same argument 
as in the case of one independent function, we fmd that the required curve 
y = (x), z = 2(x) must again be an extremal, i.e., satisfy the Euler equations 


d d 
a faa hee @. 


The boundary conditions are now 


en 


te) , 7 

[Fy + BUF YF — 2 Fedllansy = 0, 
ag ’ U 

[FL + ez (F - VFy - z'Fz))|2=25 = 0, 
au ’ if 

e+ BE y8e = £2 
oy ’ f 

[Fe + 5 (F — y'Fy — 2'Fe)le-x, = 9, 


and are again called the transversality conditions. 


15. Broken Extremals. The Weierstrass-Erdmann Conditions 


So far, we have only considered functions defined for smooth curves, 
and hence we have only permitted smooth solutions of variational problems. 
However, it is easy to give examples of variational problems which have no 
solutions in the class of smooth curves, but which have solutions if we extend 
the class of admissible curves to include piecewise smooth curves. Thus, 
consider the functional 


Jbl =f v0 -»Pdx, WD = WD aL 
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The greatest lower bound of the values of J[y] for smooth y = y(x) satisfying 
the boundary conditions is obviously zero, but it does not achieve this value 
for any smooth curve. In fact, the minimum is achieved for the curve 


0 for -l<x<0O, 


a a x for O<x<l, 


which has a corner (i.e., a discontinuous first derivative) at the point x = 0. 
Such a piecewise smooth extremal with corners is called a broken extremal. 

Another problem involving broken extremals has already been encountered 
in Example 2, p. 20. There it is required to find the curve joining two points 
(Xo, Yo) and (x,, ¥;) which generates the surface of least area when rotated 
about the x-axis. As already noted, if y, and y, are sufficiently small 
compared to x, — Xp, the solution of the problem is given by the broken 
extremal 4x)x,B shown in Fig. 2(b), p. 21. This extremal consists of three 
line segments (two vertical and one horizontal) and can be included in the 
class of piecewise smooth curves if we set up the problem in parametric form. 

Guided by the above considerations, we enlarge the class of admissible 
functions, relaxing the requirement that they be smooth everywhere. Thus, 
we pose the following problem: Among all functions y(x) which are continuously 
differentiable for a < x <b except possibly at some point c (a <c <b), 
and which satisfy the boundary conditions 


Ya)= A, yb) = B, (16) 


find the function for which the functional 


Jb = [Fess y) ae 


has a weak extremum. It is clear that on each of the intervals [a, c] and 
[c, 6] the function for which J[y] has an extremum must satisfy the Euler 
equation 
|e aT (17) 
¥ dx * , 


Writing J[y] as a sum of two functionals, i-e., 


J[y] = in F(x, y, y’) dx 
=| Fea xy) dx + f ” F(x, yy’) dx = AL] + Joly, 


we calculate the variations 8J, and 8J, of the two terms separately. The 
end points x = a, x = b are fixed, and we require that the two “pieces” 
of the function »(x) join continuously at x = c, but otherwise the point 
x = ccanmove freely. Using formula (5) to write 5/, and 8J2, and recalling 
that p(x) is an extremal, we find that 
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J, = Fylex0x0 dy. + (F = y Fa dlisent 8x1, 
iJ_ = — Fylexe'so sy, (iF = yFy)|r=c+0 3x). 


{The condition that y(x) be continuous at x = c implies that 8J, and dJ, 
involve the same increments 5x, and Sy,.] At an extremum we must have 


bJ = 8J, + SJ, = 0, 
and hence 


CPalkedes _ Foliseie) by, 
=F ((F — VF )\ies0-0 -(F- yFy)\ 22040] dx, = 0. 


Since 5x, and Sy, are arbitrary, the conditions 


Fy|rnc-0 = Fylsaeso> (18) 
(F = Ey) lesec0 = (F = YFy 2-040) 


called the Weierstrass-Erdmann (corner) conditions, hold at the point c 
where the extremal has a corner. 

In each of the intervals [a,c] and [c, 5], the extremal y = y(x) must 
satisfy Euler’s equation (17), i.e., a second-order differential equation. 
Solving these two equations, we obtain four arbitrary constants, which can 
then be found from the boundary conditions (16) and the Weierstrass- 
Erdmann conditions (18). 

The Weierstrass-Erdmann conditions take a particularly simple form if 
we use the canonical variables 


p=Fy, H=—F+y'Fy 


introduced in Sec. 13. In fact, then the conditions (18) just mean that 
the canonical variables are continuous at a point where the extremal has a 
corner. 

The Weierstrass-Erdmann conditions have the following simple geometric 
interpretation: Let x and y take fixed values, plot the value of y’ along one 
coordinate axis, and plot the values of F(x, y, y') along the other. The 
result is a curve, called the indicatrix, representing F(x, y, y’) as a function of 
y. Then the first of the conditions (18) means that the tangents to the 
indicatrix at the points y’(c — 0) and y‘(c + 0) are parallel, while the second 
condition, which can be written in the form 


Flr-c+o = Flzsc-o = Fyy'|r=c+0 a Fy-Y'|z=c-05 


means that the two tangents are not only parallel, but in fact coincide. 


PROBLEMS 


1. Justify the application of Theorem 2, p. 13 to the case of variable end point 
problems. 
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2. Derive the formula for the general variation of a functional of the form 


J) = [* FG,» ») dx + Gro, os x1 ¥2)- 


3. Derive the formula for the general variation of a functional of the form 
ay 
J{y] = i) F(x, y, y’, y”) dx. 
Zo 
4. Find the curves for which the functional 


TS 
Jy] = [ (y? — y) dx, 


can have extrema, given that y(0) = 0, while the right-hand end point can 
vary along the line x = 1/4. 


5. Find the curves for which the functional 


1V1+4 y2 
J[y] = ea 


can have extrema if 


¥(0) = 0 


a) The point (x1, yi) can vary along the line y = x — 5; 
b) The point (x,, yi) can vary along the circle (x — 9)? + y? = 9. 
Ans. a)y = +V10x — x; b) y= 4V8x — 


6. Find the curve connecting two given circles in the (vertical) plane along 
which a particle falls in the shortest time under the influence of gravity. 


7. Find the shortest distance between the surfaces z = 9(x, y)andz = (x, y). 


8. Write the transversality conditions for the functional in Prob. 2 if the end 
points of the admissible curves y = y(x) lie on two given curves y = 9(x) 
and y = d(x). 


9. Write the transversality conditions for a functional of the form 
Ilys 2) = [Sen y, VT + 9? + 2? dx 
Zo 


defined for curves whose end points lie on two given surfaces z = 9(x, y) 
and z = (x, y). Interpret the conditions geometrically. 


10. Find the curves for which the functional 
Jly, z) = fe (y? + 2 + 2yz) dx 
o 


can have extrema, given that »(0) = z(0) = 0, while the point (x, yi, 21) 
can vary in the plane x = x,. 
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11. Show that for functionals of the form 
Zz 
Jly] = | “f(x, VT + y7 et 2-1’ dy, 
Zo 


the transversality conditions reduce to the requirement that the curve y = y(x) 
intersect the curves y = 9(x) and y = (x) [along which its end points vary] 
at an angle of 45°. 


12. Find the curves for which the functional 
1 
J{y] = i) (i + y"?) dx 
0 


can have extrema, given that »(0) = 0, y’(0) = 1, y(1) = 1, while y’(1) can 
vary arbitrarily. 


13. Minimize the functional 


Ji= fo ytd, WD = -1, MD =1 


Hint. Although the extremal y = x"/9 has no derivative at x = 0, it is 
easily verified by direct calculation that y = x?!? minimizes J[y]. 


14. Given an extremal y = y(x), possibly only piecewise smooth, of the 
functional 


J{y] = i) , F(x, y, y’) dx, (Xo) = Yo, Yi) = X41, 
Zo 


suppose that 
Fyy[x, y(x). z] # 0 


for all finite z. Prove that y(x) is then actually smooth, with a smooth 
derivative, in [xo, x]. 


Hint. Use Theorem 3 of Sec. 4 and the geometric interpretation of the 
Weierstrass-Erdmann conditions given at the end of Sec. 15. 


15. Prove that the functional 


J{y] = | * (ay? + byy’ + cy?) dx, y(%o) = Yo, Wx) = yi, 


zo 


where a ¥ 0, can have no broken extremals. 


16. Does the functional 
71 
JDI= |" y% dx, 0) = 0, ym) =» 
0 


have broken extremals? 


17. Find the extremals of the functional 
4 
JTyJ = ik (x — 1°)’ + 1)? dx, yO) = 0, (4) =2 


which have just one corner. 
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18. Find the curve for which the functional 
1.) 
Jol=[ Fayydx  y¥@= 4, Wb) =B 


has an extremum if the curve can arrive at (6, B) only after touching a given 
curve y = 9(x). 


19. Given a curve y = 9(x) and two points (a, A), (6, B) lying on opposite 
sides of the curve, consider the functional 


J{y] = i F(x, y, y’) dx, y(a) = A, y(b) = B, 


where F(x, y, Y) = Fi(x, y, y’) on the side of the curve corresponding to 
(a, A), and F(x, y, »’) = F(x, y, y’) on the side of the curve corresponding to 
(6, B). Find the curve y = y(x) for which J[y] has an extremum. 


20. Using Fermat’s principle (pp. 34, 36), specialize the results of Probs. 18 
and 19 to functionals of the form 


b 
[ fe v4 ¥? ax, 
thereby deriving the familiar laws of reflection and refraction for light rays. 


21. Find the curves for which the functional 
10 
Jiy\= fo ydx, 0) = 0, (10) = 0 


can have extrema, given that the admissible curves cannot penetrate the interior 
of the circle with equation 


(x — 5)? + y? =9, 


+ ix fo O<x< ig, 
Ans. y=(+V9—(x— 5)? for <x < %, 
¥2(x — 10) for 32 < x < 10. 


4 


THE CANONICAL FORM 
OF THE EULER EQUATIONS 
AND RELATED TOPICS 





As already remarked in Sec. |, many physical laws can be expressed as 
variational principles, i.e., in terms of extremal properties of certain func- 
tionals. In this chapter, we shall illustrate this situation by using variational 
methods to study the classical mechanics of a system consisting of a finite 
number of particles. For example, we shall show how the trajectories in 
phase space of a mechanical system (which describe how the system evolves 
in time) can be found as the extremals of a certain functional. By using the 
calculus of variations, we can also find quantities connected with a given 
physical system which do not change as the system evolves in time. These 
and related ideas will be our chief concern here. First, we return to the 
subject of canonical variables (introduced in Sec. 13), and discuss the reduc- 
tion of the Euler equations to canonical form. Appendix | (p. 208) is closely 
related to the subject matter of this chapter, and contains another, independent 
derivation of the canonical equations and the Hamilton-Jacobi equation. 


16. The Canonical Form of the Euler Equations 


The Euler equations corresponding to the functional 


& 
IDiare ss Ial = [oF Yasar Ya Io) a (1) 
67 
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(which depends on n functions) form a system of m second-order differential 
equations 

ia Pir Tbe. ssn): (2) 
This system can be reduced (in various ways) to a system of 2n first-order 


differential equations. For example, regarding yi,..., y, as 7 new functions, 
independent of y,,..., ¥,a, We Can write (2) in the form 


Oy, F, — 2, =0 (i = 1,...,”), (3) 
where yi, ---)¥nas ¥iy-- +> Yn are 2n unknown functions, and x is the independ- 
ent variable. However, we obtain a much more convenient and symmetric 
form of the Euler equations if we replace x, ¥;,..., Yn: Yi, ---» Yn by another 
set of variables, i.e., the canonical variables introduced in the preceding 
chapter. The reader will recall that in Sec. 13, we used the equations 


Pp, = F,. G@=1,...,n) (4) 
to write y},..., ¥, as functions of the variables? 


Xy V1y++ +9 Yn> Pis-++> Pa: (5) 


Then we expressed the function F(x, y1,..., Yn» Yis-++» Ye) appearing in 


(1) in terms of a new function H(x, y1,..-, Yn» Pis- ++» Pn) elated to F by 
the formula 


H=-F+ > yips (6) 
i=l 


where the y; are regarded as functions of the variables (5). The function 
H is called the Hamiltonian (corresponding to the functional J[y,,..., Yn])- 
Finally, we introduced the new variables 


X,Viy sees Vas Pis-+ +s Dw A, (7) 


In other words, here (and elsewhere in this chapter), we regard the »; as new 
“‘variables.” To avoid confusion, it would be preferable to write z, instead of yj, but 
we shall adhere to the commonly accepted notation. Thus, in cases where we are con- 
cerned with the derivative of a function »,, we shall emphasize this fact by writing 
dy,{ dx instead of y;. 


2? As already noted on p. 58, in making the transition from the variables x, yi,...; Yn» 
Vis «++, Yq to the variables x, y1,..-, Yn Pt» - ++, Pn» WE Tequire that the Jacobian 
ts) aise 
Wess -s-2 Ps) — det Ii 


AY, «- +, Yn) 
be nonzero. We shall assume that this condition is satisfied. However, it should be 
kept in mind that this condition guarantees only the /ocal ‘‘solvability”” of the equations 
(4) with respect to yi,..., ys, but it does not guarantee the possibility of representing 
Yi,-++,¥n aS functions of x, ¥1,..., ¥n,Pi,---,;Pn Which are defined over the whole 
region under discussion. Thus, all our considerations have a /ocal character. 
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called the canonical variables (corresponding to the functional J[),,..., y,]), 
which were used on p. 58 to write a concise expression for the general variation 
of the functional J[y,,..., y,], and on p. 63 to give a simple interpretation 
of the Weierstrass-Erdmann conditions. 

We now show how the Euler equations (3) transform when we go over to 
canonical variables. In order to make this change in the Euler equations, 
we have to express the partial derivatives F,, (i.e., the partial derivatives of F 
with respect to y,, evaluated for constant x, y;,..-., y,) in terms of the partial 
derivatives H,, (evaluated for constant x, pi,...,Pzn)-2 The direct evaluation 
of these derivatives would be rather formidable. Therefore, to avoid lengthy 
calculations, we write the expression for the differential of the function H. 
Then, using the fact that the first differential of a function does not depend 
on the choice of independent variables (i.e., is invariant under changes 
of the independent variables), we shall obtain the required formulas quite 
easily. 

By the definition of H, we have 


dH =—dF+ > pdyt+ > yidp, 
{=1 {=1 


so that 
OF 2. OF .. OF ,, 
dH =— = dx— 2, wy i— 2 aya 


: . (8) 
+> pdt > nap. 
t=] {=] 


Ordinarily, before using (8) to obtain expressions for the partial derivatives 
of H, we would have to express the dy; in terms of x, y,, and p, However 
(and this is the important feature of the canonical variables), because of the 
relations 


7 = Pi (Gi = 1,...,n), 


dy + > vi dp. 9 
ay, Dit 2, via (9) 


Thus, to obtain the partial derivatives of H, we need only write down the 
appropriate coefficients of the differentials in the right-hand side of (9), i.e., 


oH__ oF «aH oF, 
ax Ox. ay, = a&y, dp, 7" 


> The notation ordinarily used in analysis to denote partial derivatives suffers from 
the familiar defect of not specifying just which variables are held fixed. 
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In other words, the quantities 0F/0y; and y; are connected with the partial 
derivatives of the function H by the formulas 


|. 0H 0F __ aH 


(= — —=-> 10 
* Op; oy; ay, em 
Finally, using (10), we can write the Euler equations (3) in the form 

dy, _ 0H dp, _—s OH eek 

de Op deo Oy (Gi = 1,..., 7). (11) 


These 2n first-order differential equations form a system which is equivalent 
to the system (3) and is called the canonical system of Euler equations (or 
simply the canonical Euler equations) for the functional (1). 


17. First Integrals of the Euler Equations 


It will be recalled that a first integral of a system of differential equations is 
a function which has a constant value along each integral curve of the system. 
We now look for first integrals of the canonical system (11), and hence of the 
original system (3) which is equivalent to (11). First, we consider the case 
where the function F defining the functional (1) does not depend on x 
explicitly, ie., is of the form F();,..., Yn, Vi,---> Yn)» Then the function 


H=-F+ > yp 
t=1 


also does not depend on x explicitly, and hence 


dll _ $ (@tl dy, ott dn) 
dx 


dy; dx " @p; dx (12) 


i=l 
Using the Euler equations in the canonical form (11), we find that (12) 
becomes 


dx & Ney, a, py, OM 


dH x (eo a an) = 0 
t=1 : 
along each extremal.* Thus, if F does not depend on x explicitly, the function 
H(y.,..-) ny Pty + +++ Pa) iS @ first integral of the Euler equations.® 


4 If H depends on x explicitly, the formula 
dH oH 


dx ox 
can be derived by the same argument. 
5 Cf. the discussion in Case 2, p. 18 of the integration of Euler’s equation for 
functionals which are independent of x. 
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Next, we consider an arbitrary function of the form 


® = D(yy,-- +5 Yas Pis+ + +s Pn) 


and we examine the conditions under which ® will be a first integral of the 
system (11). Wedrop the assumption that F does not depend on x explicitly, 
and instead we consider the general case. Along each integral curve of the 
system (11), we have 


2a, a® ay om dp; 
‘Oy, dx sar dx 

eo GH =8M OH 
a Oy; Op; op, Oy, 


where the expression 


is called the Poisson bracket of the functions ® and H. Thus, we have 
proved the formula 


d® 


ax 7 (2 AI (13) 


It follows from (13) that a necessary and sufficient condition for a function 
@ = O(),,..., Yn Pis+ ++» Pn) to be a first integral of the system of Euler 
equations (11) is that the Poisson bracket [®, H] vanish identically.§ 


18. The Legendre Transformation 


We now consider another method of reducing the Euler equations to 
canonical form, a method which differs from that presented in Sec. 16. 
The idea of this new method is to replace the variational problem under 
consideration by another, equivalent problem, such that the Euler equations 
for the new problem are the same as the canonical Euler equations for the 
original problem. 


18.1. We begin by discussing some related topics from the theory of 
extrema of functions of n variables. First, we consider the case n = 1. 


§ According to the existence theorem for the system (11), there is an integral curve of 
the system passing through any given point (x, ¥1,...,¥n»Pi)---)Pn)- Hence, if 
[®, H] = O along every integral curve, it follows that [®, H]= 0. If ® (as well as H) 
depends on x explicitly, it is easily verified that (13) is replaced by 


d® _ 6® 
= ay + (® HI. 
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Suppose we are looking for an extremum, say a minimum, of the function 
S(E), and suppose f(&) is (strictly) convex, which means that 


FE) > 0 


wherever /(&) is defined. We introduce a new independent variable 

p= f'(®), (14) 
called the tangential coordinate, which is just the slope of the tangent passing 
through a given point of the curve y = f(&). Since by hypothesis 


aD io» 


we can use (14) to express & in terms of p. In fact, since the function f(€) 

is convex, any point of the curve 7 = /(&) is uniquely determined by the slope 

of its tangent (see Figure 6). Of course, the 

same is true for a (strictly) concave function, 

i.e., a function such that f”(E) < 0 everywhere. 
We now introduce the new function 


H(p) = — f(E) + p&, (15) 
where & is regarded as the function of p obtained 
by solving (14). The transformation from the 
variable and function pair &, f(€) to the variable 

FiGurE 6 and function pair p, H(p), defined by formulas 

(14) and (15), is called the Legendre transform- 

ation. It is easy to see that since f(E) is convex, so is H(p). [The convex 
functions H(p) and /(&) are sometimes said to be conjugate.] In fact, 


dH = —f'(E)d& + pd& + Edp 





implies that 


dH 
and hence 
a@*H~ 4& 1 | 
se SE Et Ee), 17 
dp® ~ dp dp F*@)” a) 
dé 


since f"(E) > 0. Moreover, if the Legendre transformation is applied to 
the pair p, H(p), we get back the pair &, f(&). This follows from (16) and 
the relation 


—H(p) + pH'(p) = (©) — pH"(p) + pH'(p) = f(&). (18) 


Thus, the Legendre transformation is an involution, 1.e., a transformation 
which is its own inverse. 
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Example. If 


f®=-= @>d, 





then 
rM(3) =p= cer, 
i.e., 
gE Ze pre v, 
It follows that 
a a/(a— 1) 
H == + pk __P + ppue-D = pala-v (-2 + 1); 


and therefore 


_ Pp 
H(p) b 
where 6 is related to a by the formula 
1 1 
; + 37 1. 
Next, we show that if 
—H(p) + Ep (19) 
is regarded as a function of two variables, then 
S@) = may {[—H(p) + Ep]. (20) 


[In fact, we can use (20) instead of (15) to define the function H(p).] To 
prove this result, we note that according to (18), the function (19) reduces 
to f(E) when the condition 


pl-H) + Ep] =—H(p) + £ = 0, 
or 
E = H'(p), 


is satisfied. Thus, f(&) is an extremum of the function —H(p) + &p, 
regarded as a function of p. Moreover, the extremum is a maximum since 


Sa |-H(p) + Ep] = - HG) < 0 
[cf. (17)]. It follows that 
min S(® = min max [—# (p) + Ep), 


ie., the extremum of {(€) is also an extremum of (19), regarded as a function 
of two variables. 
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Similar considerations apply to functions of several independent variables. 
Let 


TES aE) 
be a function of n variables such that 
det Il Fevee # 0, (21) 
and let 
B=Sy (i = 1,...,n). (22) 


Then, using (22) to write &,...,&, in terms of p,,...,p,, we form the 
function 


Hy apy == fe > ED. 


As in the case of one variable, it can be shown that 


PEE) = ext [HPs Pd + > pd 


and 


Fe rr > errr Sn Pi. Pn 


ee Ss meals En) Te ext [-40. . =a Pad + > A 


where ext denotes the operation of taking an extremum with respect to the 
indicated variables. In other words, the extremum of f(&,..., &,) is also 
an extremum of 


—H(px,..-sPx) + D>, Pike 
{=1 


regarded as a function of 2” variables. 


Remark. If instead of (21), we impose the stronger condition that the 
matrix 


Sete I 


be positive definite, i.e., that the quadratic form 


n 
> Sects He 
k=1 


{, 


be positive for arbitrary real numbers a,,...,,,’ then 


F(Ex, taey E,) = goon [- #0, ao «> Pn) + > El: (23) 


7 This is the condition for the function f(E,,..., &,) to be (strictly) convex. 
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It follows from (23) that 
—H(pr,---sPn) + >, Pb < flEx,--- En) 
i=l 


for arbitrary p,..., Da, i.€., 


> Pres < H(py,.--5 Pn) a Tes: “9 Ens 


i=l 
a result known as Young’s inequality. 


18.2. We now apply the considerations of Sec. 18.1 to functionals. Given 
a functional 


b 
JD = | Fs yy) dx, (24) 
we set 
Pp be F,(x, yy’) (25) 
and 
H(x, y, p) = — F + py’. (26) 


Here we assume that F,.,, # 0, so that (25) defines y’ as a function of x, 
y and p. Then we introduce the new functional 


Jy, p) = f° [HG »p) + pyle 27) 


where y and p are regarded as two independent functions, and y’ is the deriva- 
tive of y. This functional is obviously the same as the original functional 
(24), if we choose p to be given by the expression (25). The Euler equations 
for the functional (27) are 


dH dp _ _ 0H dy _ 


ey ax” De Ga (28) 
i.e., just the canonical equations for the functional (24). If we can show 
that the functionals (24) and (27) have their extrema for the same curves, 
this will prove that the equation 


OF d OF 
ay dea 0 (29) 
and the equations (28) are equivalent, thereby providing a new derivation of 
the canonical equations, independent of the derivation given in Sec. 16. 
First, we observe that the transformation from the variables x, y, y) and 
the function F to the variables x, y, p and the function H, defined by formulas 
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(25) and (26), is an involution, i.e., if we subject H(x, y, p) to a Legendre 
transformation, we get back the function F(x, y, y’). In fact, since 


‘je oe de — ody Eyl dp: 
it follows that 
oH, 
Op =), 
and hence 
—H + pS = F— py’ + py =F. (30) 


(Cf. formula (9) of Sec. 16.] 

Next, we note that to prove the equivalence of the variational problems (24) 
and (27), it is sufficient to show that J[y] is an extremum of J[y, p] when p 
is varied and y is held fixed, symbolically 


J{y] = ext J[y, Pl, (31) 


since then an extremum of J[y, p] when both p and y are varied will be an 
extremum of J[y]. Since Jt y, p| does not contain p’, to find an extremum 
of J[y, p] it is sufficient to find an extremum of the integrand in (27) at every 
point (cf. Case 3, p. 19). Thus we have 


a Aes 
apt teva © 


from which it follows that 


, _ oH 
= ap 

But this implies (31), since’ 
oH 


according to (30). Thus, we have proved the equivalence of the variational 
problems (24) and (27), and of the corresponding Euler equations (28) and 
(29). Although we have only considered functionals depending on a single 
function, completely analogous considerations apply to the case of functionals 
depending on several functions. 


Example. Consider the functional 
b 
[ (Py? + O>%) dx, (32) 


where P and Q are functions of x. In this case, 


p=2Py', H= Py? — Qy’. 
and hence 
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The corresponding canonical equations are 

dp _ dy _P 

de 72) ae = DP’ 

while the usual form of the Euler equation for the functional (32) is 


d ; 
2yQ — ZF (2Py’) = 0. 


19. Canonical Transformations 


Next, we look for transformations under which the canonical Euler 
equations preserve their canonical form. The reader will recall that in Sec. 8 
we proved the invariance of the Euler equation 


d 
foe = av = 0 
under coordinate transformations of the form 
u = u(x, y), ur, Uy, 40. 
v = u(x, y), v, Dy 








(Such transformations change y’ to dv/du in the original functional.) The 
canonical Euler equations also have this invariance property. Furthermore, 
because of the symmetry between the variables y, and p, in the canonical 
equations, they permit even more general changes of variables, i.e., we can 
transform the variables x, y,, p; into new variables x, 


Y, am Yi(X, Yay ---+ Yay Pas - +2 Prd (33) 
P, = P(x, Vis - +9 Yn» Pry - - «> Pn): 
In other words, we can think of letting the p, transform according to their 
own formulas, independently of how the variables y, transform. However, 
the canonical equations do not preserve their form under all transformations 
(33). We now study the conditions which have to be imposed on the 
transformations (33) if the Euler equations are to continue to be in canonical 
form when written in the new variables, i.e., if the canonical equations are to 
transform into new equations 
dY,;  0oH* dP, _ _—-aH* 
dx OP, dx @Y,’ 
where H* = H*(x, Y,,..., Yn, Pi,..., P,) is some new function. Trans- 
formations of the form (33) which preserve the canonical form of the Euler 
equations are called canonical transformations. 
To find such canonical transformations, we use the fact that the canonical 
equations 








(34) 


dy, OH dp, __ @H 


deo Ope ae Oy (35) 
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are the Euler equations of the functional 


bd n 
Tyas +s Pus Pasos Pal = f(D pot — H) ds (36) 
@ Nisl 


in which the y, and p, are regarded as 2” independent functions. We want 
the new variables Y; and P, to satisfy the equations (34) for some function 
H*, This suggests that we write the functional which has (34) as its Euler 
equations. This functional is 


J*L¥ i, 0-5 Yu Pures +s Pa] = 1 > PY! — H*) de (37) 
@ Niel 


where Y, and P, are the functions of x, y,; and p, defined by (33), and Y; 
is the derivative of Y,. Thus, the functionals (36) and (37) represent two 
different variational problems involving the same variables y, and p,, and 
the requirement that the new system of canonical equations (34) be equivalent 
to the old system (35), i.e., that it be possible to obtain (34) from (35) by 
making a change of variables (33), is the same as the requirement that the 
variational problems corresponding to the functionals (36) and (37) be 
equivalent. 

In the remarks made on p. 36, it was shown that two variational problems 
are equivalent (i.e., have the same extremals) if the integrands of the corre- 
sponding functionals differ from each other by a total differential, which in 
this case means that 


> p, dy, — Hdx = > P,dY, — H* dx + d(x, yy, .. 5 Yay Pay +++» Pn) 
i=1 i=l 
(38) 


forsome function ®. Thus, if a given transformation (33) from the variables 
X, Yi Pp, to the variables x, Y;, P; is such that there exists a function ® satis- 
fying the condition (38), then the transformation (33) is canonical. In this 
case, the function ® defined by (38) is called the generating function of the 
canonical transformation. The function ® is only specified to within an 
additive constant, since, as is well known, a function is only specified by its 
total differential to within an additive constant. 

To justify the term “‘ generating function,’ we must show how to actually 
find the canonical transformation corresponding to a given generating 
function D. This is easily done. Writing (38) in the form 


d® = © p,dy,— >, P,dY, + (H* — H) dx, 
i=1 i=l 
we find that® 
act = ene = (39) 
CX 





5 @® is originally a function of x, y, and p,. However, by using (33), we can write ® 
as a function of the variables x, », and Y. 
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Then (39) is precisely the desired canonical transformation. In fact, the 
2n + 1 equations (39) establish the connection between the old variables 
yi, P; and the new variables Y;, P;, and they also give an expression for the 
new Hamiltonian H*. Moreover, it is obvious that (39) satisfies the condition 
(38), so that the transformation (38) is indeed canonical. If the generating 
function ® does not depend on x explicitly, then H* = H. In this case, 
to obtain the new Hamiltonian H*, we need only replace y, and p,; in H by 
their expressions in terms of Y, and P;.° 

In writing (39), we assumed that the generating function is specified as a 
function of x, the old variables y, and the new variables Y;: 


® = O(x, 1, ---5 Yao ) See Y,). 


It may be more convenient to express the generating function in terms of 
y, and P, instead of y, and Y;. To this end, we rewrite (38) in the form 
d(o > P.Y,) = Dady.+ > dP, + (H* — H) dx, 
i=1 i=1 i=1 


thereby obtaining a new generating function 


0+ > PY, (40) 


t=1 


which is to be regarded as a function of the variables x, y, and P;. Denoting 
(40) by V(x, y1,---, n> Pi,s--+> Pa), We Can write the corresponding canon- 
ical transformation in the form 


ames yoo. Ho H4+ 2. 


Oy, aP, Ox On 


20. Noether’s Theorem 


In Sec. 17 we proved that the system of Euler equations corresponding 
to the functional 


b 
| FOn Ie He Das (42) 
where F does not depend on x explicitly, has the first integral 
H=-F+ > yiFy. 
t=1 
It is clear that the statement “‘ F does not depend on x explicitly”’ is equivalent 


to the statement ‘“‘F, and hence the integral (42), remains the same if we 
replace x by the new variable 


x*=xte, (43) 


° A similar remark holds for the function ¥ in (41). 
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where « is an arbitrary constant.’ It follows that A is a first integral of 
the system of Euler equations corresponding to the functional (42) if and 
only if (42) is invariant under the transformation (43).!° 

We now show that even in the general case, there is a connection between 
the existence of certain first integrals of a system of Euler equations and the 
invariance of the corresponding functional under certain transformations 
of the variables x, y,,...,¥,- We begin by defining more precisely what 
is meant by the invariance of a functional under some set of transformations. 
Suppose we are given a functional?! 


Zz. 
7 2 | FO isk Pai neaia Poy ON 
Zo 
which we write in the concise form 
JU = [" Feary) ax, (44) 


where now y indicates the n-dimensional vector (),,...,y,) and y’ the 
n-dimensional vector (yi,..., y,). Consider the transformation 


x* = D(x, Vi... 65 Vas Vass ++» Vad = D(x, y, y’), (45) 
Ve = Vi, V1. Yar Yr In) = Filey, »’)s 


where i = l,...,”. The transformation (45) carries the curve y, with the 
vector equation 


y=YxX) WH <xX< x), 


into another curve y*. In fact, replacing y, y’ in (45) by y(x), y’(x), and 
eliminating x from the resulting » + 1 equations, we obtain the vector 
equation 

ye = y*x*) (Xd < x* < xf) 
for y*, where y* = (y¥,..., y¥*). 


DEFINITION. The functional (44) is said to be invariant under the 
transformation (45) if J[y*] = Jy], ie. if 


tf 3K dy* * 7 dy 
le F(x y ea) dx* = ik F (x,y, 3) dx. 


te) 


10 The fact that AH is a first integral only if (42) is invariant under the transformation 
(43) follows from the formula 


(see footnote 4, p. 70), since 0H/@x = 0 only if aF/ax = 0. 

11 To avoid confusion in what follows, the reader should note that the subscripts can 
play two different roles; when indexing x, they refer to different values, while when indexing 
y, they refer to different functions. For example, the y* are new functions, while x¥ and 
x¥ are the new positions of the end points of the interval [xo, x:]. 
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Example 1. The functional 
ea 
JLy] = I 7 y? dx 

Zo 

is invariant under the transformation 
x*=x+te, yr=y, (46) 
where ¢ is an arbitrary constant. In fact, given a curve y with equation 
Y=VWX) (HS X< XH), 


the ‘“‘transformed” curve y*, i.e., the curve obtained from y by shifting it a 
distance e along the x-axis, has the equation 


yt = yx*® —e) = y*X*) (HO + EK X* <x + 8), 
and then 


* * * 2 
we te dy*(x yy" _ opmte [2 =| "1 

Jt] ipa ae | = [Pa | & 

_ 7 oy’ = 

-f [Be dx = JLy]. 
Example 2. The integral 

J{y] = im xy"? dx 
Io 


is an example of a functional which is not invariant under the transformation 
(46). In fact, carrying out the same calculations as in Example |, we obtain 


z* d * / %\} 2 ry +e d * 2 
Jty*] = is et ve ] , lee, x* Wes =] ax* 





Suppose now that we have a family of transformations 
x* = O(x, y, y'; ©), 
YE = Fi 5), 

depending on a parameter c«, where the functions ® and ¥; (/ = 1,..., 7”) 


are differentiable with respect to «, and the value e = 0 corresponds to the 
identity transformation: 


(47) 


D(x, y, y’; 0) = x, 
Vin y V5 9) = vie 


Then we have the following result: 


(48) 


THEOREM (Noether). If the functional 


Jol = [[" Fey») dx (49) 
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is invariant under the family of transformations (47) for arbitrary xX. and 
x1, then 


n 


> Fy, + (F - > HF) @ = const (50) 
i=l 


f=1 


along each extremal of J[.y], where 





‘ OP(x, y, y'3€ 
ox, yy") = PHYS pe ) : 
oe (51) 
, oY; x, > > 
dilx, ys ¥’) = 6 pe ®) = 
e=0 





In other words, every one-parameter family of transformations leaving 
J[y] invariant leads to a first integral of its system of Euler equations. 


Proof. Suppose e is a small quantity. Then, by Taylor’s theorem, 
we have}? 








x* = O(x,y, 56) = B(x, y, 5; 0 +e ACs W'S) < + o(e), 
' i OV (x, y's 
yE = Fix, y, 3 ©) = Fix, y, 5 0) + eG wie) es o(e), 
or using (48) and (51), 


yE = + ebi(x, yy’) + Of). 
Assuming that the curve 


wax) (Il <i<n) 


is an extremal of J[y], we can use formula (11) of Sec. 13 to write an 
expression for the variation of J[y] corresponding to the transformation 
(52). Since in the present case?* 


8x => eq, by, = ely, 
the result is 


BJ =e [> Fy, + (F- yx) | 
f=1 


i=l Z=Io 


12 As usual, 1 = o(e) means that m/e — 0 as e — 0. 

13 Here 5x, 5y, mean the principal linear parts (relative to «) of the increments Ax, Ay, 
of x, y, and not simply Ax, Ay, as in Sec. 13. It is easy to see that this change in inter- 
pretation has no effect on the final result, and has the advantage of making it unnecessary 
to bother with infinitesimals of higher order. 
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Since by hypothesis, J[y] is invariant under (52), 5J vanishes, i-e., 
[5 Ba + (PF 3 iru) o] 
i=1 i=1 I=I9 
= [> Fy, + (F -~> YF) @] 
{=1 t=1 r=2) 


The fact that (50) holds along each extremal now follows from the 
arbitrariness of x) and x. 


Remark. In terms of the canonical variables p; and H, equation (50) 
becomes simply 


n 


> pi — He = const. (53) 
i=l 
Example 3. Consider the functional 
Jiy) = f° FO, y) dx, (54) 
to 


whose integrand does not depend on x explicitly. Then, by exactly the 
same argument as given in Example 1, J[y] is invariant under the one- 
parameter family of transformations 

x*=xte, ye =). (55) 
In this case, 


and (53) reduces to just 
H = const, 


i.e., the Hamiltonian H is constant along each extremal of J/[y]. Thus, we 
again obtain a result already proved in Sec. 17: For a functional of the 
form (54), which does not dépend on x explicitly, the Hamiltonian is a first 
integral of the system of Euler equations. 


21. The Principle of Least Action 


We now apply the general results obtained in the preceding sections to 
some mechanical problems. Suppose we are given a system of n particles 
(mass points), where no constraints whatsoever are imposed on the system. 
Let the ith particle have mass m; and coordinates x,,y,,z, (i= 1,..., n). 
Then the kinetic energy of the system is }* 


T= 5 > m2 + 2+ 2). (56) 
t=1 


14 Here ¢ denotes the time, and the overdot denotes differentiation with respect to f. 
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We assume that the system has potential energy U, i.e., that there exists a 
function 


U= U(t, X15 Viy Z19- + +9 Xny Wy Zn) (57) 
such that the force acting on the ith particle has components 


ou ou ou 
=) ee Z=-5 


Next, we introduce the expression 
L=T- U, (58) 


called the Lagrangian (function) of the system of particles. Obviously, L is 
a function of the time ¢ and of the positions (x;, y,, z,) and velocities (%,, };, Z;) 
of the » particles in the system. 

Suppose that at time f) the system is in some fixed position. Then the 
subsequent evolution of the system in time is described by a curve 


x= x(t), w= yt), 2 = z(t) (Gi =1,...,”) 


in a space of 3n dimensions. It can be shown that among all curves passing 
through the point corresponding to the initial position of the system, the 
curve which actually describes the motion of the given system, under the 
influence of the forces acting upon it, satisfies the following condition, 
known as the principle of least action: 


THEOREM. The motion of a system of n particles during the time 
interval [to, t,] is described by those functions x,(t), y,(t), 2(t), 1 < i <n, 
for which the integral 


ty 
Ld, (59) 
to 
called the action, is a minimum. 


Proof. We show that the principle of least action implies the usual 
equations of motion for a system of 7 particles. If the functional (59) 
has a minimum, then the Euler equations 


6L dd OL _ 


ax, di ax, 

OL d oL 

ay, dt oy, 0, (60) 
a da _y 

Oz; dt Oz; = 


must be satisfied for i = 1,...,n. Bearing in mind that the potential 
energy U depends only on ?, x,, y;, z;, and not on X;, );, z,, while T is a 
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sum of squares of the velocity components %,, );, Z, (with coefficients 
4m,), we can write the equations (60) in the form 


_oU a x =0 

Ox, Fie ee 

ou d a 

oy, ht my, = 0, (61) 
BU ods 

~ z, ae a 


Finally, since the derivatives 
aU, au, _ au 
Ox, oy; 02; 
are the components of the force acting on the ith particle, the system 
(61) reduces to 


mx; = X, 
my = Yi, 
mz, = Zi, 


which are just Newton’s equations of motion for a system of n particles, 
subject to no constraints. 


Remark 1. The principle of least action remains valid in the case where the 
system of particles is subject to constraints, except that then the admissible 
curves, for which the functional (59) is considered, have to satisfy the con- 
straints. In other words, in this case, application of the principle of least 
action leads to a variational problem with subsidiary conditions. 


Remark 2. Actually, as we shall see later (Sec. 36.2), the principle of 
least action only holds for sufficiently small time intervals [to, t,], and has 
to be modified for continuous mechanical systems. 


22. Conservation Laws 


We have just seen that the equations of motion of a mechanical system 
consisting of n particles, with kinetic energy (56), potential energy (57) and 
Lagrangian (58), can be obtained from the principle of least action, i.e., by 
minimizing the integral 


i Lae if (T — U)dt. (62) 
The canonical variables corresponding to the functional (62) turn out to be 
é 5 
Piz = ox, = MX, 


OL ; 
Py = ay; = my, 

OL 5 
Pz = 23, = MZ, 
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which are just the components of the momentum of the ith particle.® In 
terms of p;;, pi, and p,;,, we have 


H= > (Xie + WDiy + 4Piz) — L = 2T —(T- U)=T + U, 
i=l 


so that H is the total energy of the system. 

Using the form of the integrand in (62), wecan find various functions which 
maintain constant values along each trajectory of the system, thereby 
obtaining so-called conservation laws. 


1. Conservation of energy. Suppose the given system is conservative, 
which means that the Lagrangian LZ (or more precisely, the potential 
energy U) does not depend on time explicitly. Then, as shown in 
Sec. 17 (see also Sec. 20, Example 3), H = const along each extremal, 
i.e., the total energy of a conservative system does not change during 
the motion of the system. 


2. Conservation of momentum. First, we recall that according to Noether’s 
theorem (Sec. 20), invariance of the functional (49) under the family of 
transformations 

x* = Ox, y, y'; ©) = x, 

yE = Vix, y's ©) 
implies that the corresponding system of Euler equations has the first 
integral 


n 
> Fy, = const, 
f=1 

where 


OV (x, y, v3 €) 
de 





Vix, ys y’) = 


e=0 
since in this case, 


aD(x, y, y’; €) 


(x, ys ¥') = 5c = 0. 





£€=0 
Therefore, the invariance of the functional (62) under the transformation 
xP=xt+e, WR=y, way 


implies that 


n 
> Piz = const. 
{=1 


© By analogy with mechanical problems, the variables p, = F,; are often called the 
momenta, regardless of the interpretation of the integrand F appearing in the functional (1). 
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Similarly, it follows from the invariance of (62) under displacements 
along the y-axis that 


n 
> Piy = const, 
f=1 


and from the invariance of (62) under displacements along the z-axis that 


n 
> Pyz = const. 
i=1 


The vector P with components 


P.= > Dw Pp > Dn P= > hs 
{=1 {=1 {=1 


is called the total momentum of the system. Thus, we have just proved 
that the total momentum is conserved during the motion of the system 
if the integral (62) is invariant under parallel displacements. _ [It is clear 
from these considerations that the invariance of (62) under displace- 
ments along any coordinate axis, e.g., along the x-axis, implies that 
the corresponding component of the total momentum is conserved.] 


. Conservation of angular momentum. Suppose the integral (62) is 


invariant under rotations about the z-axis, i.e., under coordinate 
transformations of the form 


x* = x,cose + y; sine, 








yf = —x, sine + y, cose, 
zy = 2%. 
In this case, 
ice Ox* 
iz ~~ Oz cea = is 
uy = oyF =-—-X 
iv: Oe exo 1» 
* 
Nie = ee = 0, 
de e=0 





and hence Noether’s theorem implies that 
S (5 -_ 5%) = const 
a \ex,7' ay, > 
ie., 
> (Piz — PivXi) = const. (63) 
{=1 


Each term in this sum represents the z-component of the vector product 
Pp; x mj, wherer; = (x, ¥;, Z;,) is the position vector and py = (Piz, Piys Piz) 
the momentum of the ith particle. The vector p, x r; is called the 
angular momentum of the ith particle, about the origin of coordinates, 


88 CANONICAL FORM OF THE EULER EQUATIONS CHAP. 4 


and (63) means that the sum of the z-components of the angular 
momenta of the separate particles, i.e., the z-component of the total 
angular momentum (of the whole system) is a constant. Similar asser- 
tions hold for the x and y-components of the total angular momentum, 
provided that the integral (62) is invariant under rotations about the x 
and y-axes. Thus, we have proved that the total angular momentum 
does not change during the motion of the system if (62) is invariant 
under all rotations. 


Example 1. Consider the motion of a particle which is attracted to a 
fixed point, according to some law. In this case, energy is conserved, since 
Lis time-invariant, and angular momentum is also conserved, since L is 
invariant under rotations. However, momentum is not conserved during 
the motion of the particle. 


Example 2. A particle is attracted to a homogeneous linear mass distri- 
bution lying along the z-axis. In this case, the following quantities are 
conserved: 


1. The energy (since L is independent of time); 
2. The z-component of the momentum; 
3. The z-component of the angular momentum. 


23. The Hamilton-Jacobi Equation. Jacobi’s Theorem’® 


Consider the functional 
JUD = [FG ye Pe Wis Yad ax (64) 
Zo 


defined on the curves lying in some region R, and suppose that one and only 
one extremal of (64) goes through two arbitrary points A and B. The 
integral 


S= [FOI Ie Pies Ia) a (65) 
Zo 
evaluated along the extremal joining the points 


A= (Xo, yi, - : =e VR); B= (1, Vis - +s Yad (66) 


is called the geodetic distance between Aand B. The quantity S is obviously 
a single-valued function of the coordinates of the points A and B. 


18 Tn this section, we drop the vector notation introduced in Sec. 20, and revert to the 
more explicit notation used earlier. The vector notation will be used again later 
(e.g., in Sec. 29). 
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Example 1. If the functional J is arc length, S is the distance (in the usual 
sense) between the points A and B. 

Example 2. Consider the propagation of light in an inhomogeneous and 
anisotropic medium, where it is assumed that the velocity of light at any 
point depends both on the coordinates of the point and on the direction of 
propagation, i.e., 

v = u(x, y, 2, X, y, 2). 
The time it takes light to go from one point to another along some curve 
x=x(t), y=yt), z= 2(t) 
is given by the integral 
to v 


T= dt. (67) 
According to Fermat’s principle, light propagates in any medium along the 
curve for which the transit time 7 is smallest, i.e., along the extremal of the 
functional (67). Thus, for the functional (67), S is the time it takes light 
to go from the point A to the point B. 

Example 3. Consider a mechanical system with Lagrangian L. According 
to Sec. 21, the integral 


ty 
I L(t, X14 Vay Z1y +++) Xnv Yay Zn) at 
0 


evaluated along the extremal passing through two given points, i.e., two 
configurations of the system, is the “least action” corresponding to the 
motion of the system from the first configuration to the second. 
Iftheinitial point A is regarded as fixed andthe final point B = (x,¥1,..-,¥n) 
is regarded as variable,!” then in the region R, 
5 = SOQ Vy iia Pa (68) 


is a Single-valued function of the coordinates of the point B. We now 
derive a differential equation satisfied by the function (68). We first 
calculate the partial derivatives 


oS oS , 
Dx. ay, G =1,...,n), 


by writing down the total differential of the function S, i.e., the principal 
linear part of the increment 


AS = S(x = dx, Vi + dy, ata so Dan + dy,) _ S(x, Vis ae > Da) 
Since, by definition, AS is the difference 


Jly*] — Jfyl, 


17 Since B is now variable, we drop the superscript in the second of the formulas (66). 
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where y is the extremal going from 4 to the point (x, yi1,..., ¥,) and y* is 
the extremal going from A to the point (x + dx, y, + dy,,...,¥, + dyn), 
we have 

dS = 8, 


where the “unvaried”’ curve is the extremal y and the initial point A is held 
fixed. (The fact that the “varied” curve y* is also an extremal is not 
important here.) 

Thus, using formula (12) of Sec. 13 for the general variation of a functional, 
we obtain 


dS(x, yi, oe «> Yn) = bd = » Py dy, — H dx, (69) 
i=1 


where (69) is evaluated at the point B. It follows that 


ain =P (70) 
where 18 

Pr = Pils Vases +s Vn) = Fy be, Yas e+ +s Vas Vil), -- +s Yal)] (71) 
and 

H = Hx, Yipes Yas Pi%s Vas 0 Vady e - -9 Pa %y Yas - Yad 


are functions of x, )1,...,¥p. Then from (70) we find that S, as a function 
of the coordinates of the point B, satisfies the equation 


os os | a (72) 


Ox + H (Yn In Gove Be 


The partial differential equation (72), which is in general nonlinear, is called 
the Hamilton-Jacobi equation. There is an intimate connection between the 
Hamilton-Jacobi equation and the canonical Euler equations. In fact, the 
canonical equations represent the so-called characteristic system associated 
with equation (72).19 We shall approach this matter from a somewhat 
different point of view, by establishing a connection between solutions of the 
Hamilton-Jacobi equation and first integrals of the system of Euler equations: 


THEOREM |. Let 


S= SOX, Vas s+ +s Vas Lay + + +9 Sm) (73) 


1®In (71), yx) denotes the derivative dy,/dx calculated at the point B for the 
extremal y going from A to B. 

18 See e.g., R. Courant and D. Hilbert, Methods of Mathematical Physics, Vol. H, 
Interscience, Inc., New York (1962), Chap. 2, Sec. 8. 
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be a solution, depending on m (<n) parameters a,...,%m Of the 
Hamilton-Jacobi equation (72). Then each derivative 


os —— 
ba, (i = 1, ery m) 
is a first integral of the system of canonical Euler equations 


dy, 0H dp, oH 


ax Op, dx oy,” 


S we 
Ba, ~ const Gi =1,...,m) 


along each extremal. 


Proof. We have to show that 








d (aS ey 
5, (#2) =° (Pecigoncm (74) 
along each extremal. Calculating the left-hand side of (74), we find 
that 
d (0S\_ aS " 9S dy, 
dx (3) = bx oa, * pa By, Ou, dx (75) 


Substituting (73) into the Hamilton-Jacobi equation (72), and 
differentiating the result with respect to «,, we obtain 





eS = > 0H &S 


Ox Oa, e: k=1 Ox Ve Bot, (76) 


Then substitution of (76) into (75) gives 
4 (2) ae S oH aS * 6878) dy, 








dx \da; Di. OY, Orn, mn 1 Vy, Om ‘dx 
5 (oh 
Km Wr On, \ dx Op, 
Since 
dy, OH _ fs 
dx op (k = 1,...,n) 


along each extremal, it follows that (74) holds along each extremal, 
which proves the theorem. 


THEOREM 2 (Jacobi). Let 


S = SOX, Vis. ss Vas hay + oy Mn) (77) 


be a complete integral of the Hamilton-Jacobi equation (72), i.e., a general 
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solution of (72) depending on n parameters «,,...,%,. Moreover, let the 
determinant of the n x n matrix 


as 














Cay OY, U8) 
be nonzero, and let By,...,8, be n arbitrary constants. Then the 
functions 

Vi = VAX, Or, ---5 Ens Br, ---» Ba) = 1,...,7”) (79) 
defined by the relations 
fs) Z 
a S(X, Viss +e Var Cass Oe = By C= 1,...,n), (80) 
i 
together with the functions 
(2) . 
Pi = Fy SOs Vase +s Vns Say + En) = 1,..., 1); (81) 
vi 


where the y, are given by (79), constitute a general solution of the canonical 
system 

dy, oH dp, oH . 

dx Op, dx oy G@=1,...,n). (82) 

Proof 1. According to Theorem 1, the vn relations (80) correspond 

to first integrals of the canonical system (82). To obtain the general 
solution of (82), we first use (80) to define the n functions (79) [this is 
possible since (78) has a nonvanishing determinant], and then use (81) 
to define the ” functions p;. To show that the functions y, and p, so 
defined actually satisfy the canonical equations (82), we argue as follows: 
Differentiating (80) with respect to x, where the y, are regarded as 
functions of x [cf. (79)], we obtain 


d (25) as $ as d, & &S (2: eH) 
k=1 = 


dx \da,) ax da, Oy, Oa, dx Ly Oy, Oar 











dx ap,) 


where in the last step we have used (76). Since the determinant of the 
matrix (78) is nonzero, it follows that 


dy, _ 0H 


Ban @=1y.22,9); (83) 


which is just the first set of equations (82). 
Next, we differentiate (81) with respect to x, obtaining 











as eS) eS SOS dy OS, S _ es oH 
dx dx \dy,J Ox dy, * Fy Oy, dy, dx Ox dy, Ly Oy, OY; Oy 
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where we have used (83). Then, taking account of (81) and differ- 
entiating the Hamilton-Jacobi equation (72) with respect to y,, we 
find that 

OS __OH_ y OH @S 

Ox OY; oy, 4 Pu Ve OY 


A comparison of the last two equations shows that 


ae aa G@ =1,...,n), 


which is just the second set of equations (82). 


Proof 2. Our second proof of Jacobi’s theorem is based on the use 
of a canonical transformation. Let (77) be a complete integral of the 
Hamilton-Jacobi equation. We make a canonical transformation of 
the system (82), choosing the function (77) as the generating function, 


01,---, 4, aS the new momenta (cf. footnote 15, p. 86), and B,,..., By 
as the new coordinates. Then, according to formula (41) of Sec. 19, 
os os * as 
—- — 3 =) = H Sones 
Pi oy, Bs Oa, “i + Ox 


But since the function S satisfies the Hamilton-Jacobi equation, we 
have 


Hien a6. 
Ox 
Therefore, in the new variables, the canonical equations become 
da, _ dBi an 
dx 3 dx ° 


from which it follows that «, = const, 8; = const along each extremal. 
Thus, we again obtain the same z first integrals 


os 

a, 
of the system of Euler equations. If we now use these equations to de- 
termine the functions (79) of the 2” parameters «,,...,%,,Bi,.--, Br, 


and if, as before, we set 


(7) 
i ay, S(x, V1 cosy Vas Lise ees Xn), 
where the ), are given by (79), we obtain 2n functions 


yilx, Aiy-- +9 Any Bi, eS | Bn), 
Pi(x, Ay, ++ +4 Hy Bi, ash 28) B.), 


which constitute a general solution of the canonical system (82). 
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PROBLEMS 


1. Use the canonical Euler equations to find the extremals of the functional 


f Vx2 4+ Vv T+ y2 dx, 
and verify that they agree with those found in Chap. 1, Prob. 22. 
Hint. The Hamiltonian is 
H(x, y,p) = — Vx? + y? — p3, 
and the corresponding canonical system 


dp _ y dy P 


ax Vey pip dx Vet yt —p 
has the first integral 

Pp? = y = Cc, 
where C is a constant. 


2. Consider the action functional 
a l(t ee _ yy? 
J [x] an (mx xx?) dt 


corresponding to a simple harmonic oscillator, i.e., a particle of mass m 
acted upon by a restoring force —»xx (cf. Sec. 36.2). Write the canonical 
system of Euler equations corresponding to J[x], and interpret them. Calcu- 
late the Poisson brackets [x, p], [x, H] and [p, H]. Is p a first integral of 
the canonical Euler equations? 


3. Use the principle of least action to give a variational formulation of the 
problem of the plane motion of a particle of mass m attracted to the origin 
of coordinates by a force inversely proportional to the square of its distance 
from the origin. Write the corresponding equations of motion, the Hamil- 
tonian and the canonical system of Euler equations. Calculate the Poisson 
brackets [r, p,], [9, pal, [p,, H] and [pe, H], where 


Is pe a first integral of the canonical Euler equations? 


Hint. The action functional is 
¢ . 
Jir, 8] = [* E (? + 776%) + 4 dt, 
to r 


where & is a constant, and r, 8 are the polar coordinates of the particle. 
4. Verify that the change of variables 
Y= Dy P=y 


is a canonical transformation, and find the corresponding generating function. 
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5. Verify that the functional J[r, 0] of Prob. 3 is invariant under rotations, 
and use Noether’s theorem (in polar coordinates) to find the corresponding 
conservation law. What geometric fact does this law express? 

Ans. The line segment joining the particle to the origin sweeps out equal 
areas in equal times. 


6. Write and solve the Hamilton-Jacobi equation corresponding to the 
functional 


Jbl= [" yds, 


to 


and use the result to determine the extremals of J[y). 
Ans. The Hamilton-Jacobi equation is 


eS oS\? 
eat (=) = 0, 


7. Write and solve the Hamilton-Jacobi equation corresponding to the 
functional 


Jy] = Pavia + y? dx, 


and use the result to find the extremals of J[y). 
Ans. The Hamilton-Jacobi equation is 


oS\? eéS\? 
(FY =r 
with solution 
YY ——$$_—_—_ 
S=ax + | Vf%Xq) — oda + B. 
vo 


The extremals are 
dy 


" Ivo VP) = a 





= const. 


8. Use the Hamilton-Jacobi equation to find the extremals of the functional 
of Prob. 1. 


Hint. Try a solution of the form S = $(Ax? + 2Bxy + Cy?). 


9. What functional leads to the Hamilton-Jacobi equation 


(2) (3) 
a + [— = 1? 
ex oy 


10. Prove that the Hamilton-Jacobi equation can be solved by quadratures 
if it can be written in the form 


os “a3 es = 
o( x, a) - r(», *) = 0. 


11. By a Liouville surface is meant a surface on which the arc-length 
functional has the form 


Jy] = ik Voix) + GyY)VI + y? dx, 
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Prove that the equations of the geodesics on such a surface are 


d. d 
\Taqaa  Veanee 





where « and @ are constants. Show that surfaces of revolution are Liouville 
surfaces. 


5 


THE SECOND VARIATION. 
SUFFICIENT CONDITIONS 
FOR A WEAK EXTREMUM 


Until now, in studying extrema of functionals, we have only considered 
a particular necessary condition for a functional to have a weak (relative) 
extremum for a given curve y, i.e., the condition that the variation of the 
functional vanish for the curve y. In this chapter, we shall derive sufficient 
conditions fora functional to have a weak extremum. To find these sufficient 
conditions, we must first introduce a new concept, namely, the second 
variation of a functional. We then study the properties of the second varia- 
tion, and at the same time, we derive some new necessary conditions for an 
extremum. 

As will soon be apparent, there exist sufficient conditions for an extremum 
which resemble the necessary conditions and are easy to apply. These 
sufficient conditions differ from the necessary conditions (also derived in 
this chapter) in much the same way as the sufficient conditions y’ = 0, 
y” > 0 for a function of one variable to have a minimum differ from the 
corresponding necessary conditions y’ = 0, y” > 0. 


24. Quadratic Functionals. The Second Variation of a Functional 


We begin by introducing some general concepts that will be needed later. 


A functional B[x, y] depending on two elements x and y, belonging to some 
97 


98 SUFFICIENT CONDITIONS FOR A WEAK EXTREMUM CHAP. 5 


normed linear space &, is said to be bilinear if it is a linear functional of y for 
any fixed x and a linear functional of x for any fixed y (cf. p. 8). Thus, 


Blx + y, z] = Blx, z] + Bb, Zz], 
Blax, y] = «B[x, y], 
and 
Bx, y + z] = Blx, y] + BLx, z], 
Bix, «y] = aBLx, y] 


for any x, y,z¢@ and any real number «. 

If we set y = x in a bilinear functional, we obtain an expression called 
a quadratic functional. A quadratic functional A[x] = B[x, x] is said to be 
positive definite: if A[x] > 0 for every nonzero element x. 

A bilinear functional defined on a finite-dimensional space is called a 
bilinear form. Every bilinear form B[x, y] can be represented as 


n 
Bix, y] = bi E Mus 
t.k=1 
where &,,...,&, and 7,..., 4, are the components of the ‘“‘vectors” x and y 
relative to some basis.2_ If we set y = x in this expression, we obtain a 
quadratic form 


A[x] = B[x, y] = bikie. 


iM: 


Example 1. The expression 


Bix, y}] = f° xy at 


is a bilinear functional defined on the space % of all functions which are 
continuous in the interval a < t < b. The corresponding quadratic func- 
tional is 


2b 
A[x] = | x?(t) dt. 
Example 2. A more general bilinear functional defined on @ is 


Bx, y= fF alt)x(s)y(0) at, 


where a(f) is a fixed function. If a(t) > 0 for all ¢ in [a, 5), then the corre- 
sponding quadratic functional 


bd 
Alx] = | a(t)x(t) dt 
is positive definite. 


1 Actually, the word “definite” is redundant here, but will be retained for traditional 
reasons. Quadratic functionals A[x] such that A[x] > 0 for all x will simply be called 
nonnegative (see p. 103 ff.). 

2 See e.g., G. E. Shilov, op. cit., p. 114. 
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Example 3. The expression 
Abd = [ex + BOX") + (Ox) at 


is a quadratic functional defined on the space Q, of all functions which are 
continuously differentiable in the interval [a, 5]. 


Example 4. The integral 
b pb 
Bix, y] = | f K(s, Ox(8) 90 ds dt, 


where K(s, t) is a fixed function of two variables, is a bilinear functional 
defined on ¥. Replacing y(t) by x(t), we obtain a quadratic functional. 


We now introduce the concept of the second variation (or second differential) 
of a functional. Let J[y] be a functional defined on some normed linear 
space @ In Chapter 1, we called the functional J[y) differentiable if its 
increment 

AJ[h] = Jb + A] - Jb) 


can be written in the form 
AJ[h] = 9h] + ellAl, 


where 9[A] is a linear functional and «> 0 as |A|| > 0. The quantity ¢9[h] 
is the principal linear part of the increment AJ[A], and is called the (first) 
variation [or (first) differential] of J[y], denoted by 8J[A]. 

Similarly, we say that the functional J[y] is twice differentiable if its incre- 
ment can be written in the form 


AJ{h) = gilh] + golh] + €l|All?, 


where ¢, [A] is a linear functional (in fact, the first variation), p2[A] is a quad- 
ratic functional, and «> 0 as ||A|| > 0. The quadratic functional ¢,[h] is 
called the second variation (or second differential) of the functional J[y], 
and is denoted by 8*/[A].3 From now on, it will be tacitly assumed that we 
are dealing with functionals which are twice differentiable. The second 
variation of such a functional is uniquely defined. This is proved in just 
the same way as the uniqueness of the first variation of a differentiable 
function (see Theorem | of Sec. 3.2). 


THEOREM |. A necessary condition for the functional J[y] to have a 
minimum for y = fj is that 
s4V[y] > 0 (1) 


for y = § and all admissible h. For a maximum, the sign > in (1) is 
replaced by <. 





3 The comment made in footnote 6, p. 12 applies here as well. 
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Proof. By definition, we have 
AJ[A] = 8J[A] + 82J [A] + ellAll?, (2) 

where « > Oas ||A|| > Q. According to Theorem 2 of Sec. 3.2, d/[A] = 0 
for y = y and all admissible A, and hence (2) becomes 

AJ[A] = 8°J[A] + ellAll?. (3) 
Thus, for sufficiently small ||A||, the sign of A/[A] will be the same as the 
sign of 87J[h]. Now suppose that 87J[h)}] < 0 for some admissible 
ho. Then for any a # 0, no matter how small, we have 

SU [xho] = «73° [ho] < 0. 
Hence, (3) can be made negative for arbitrarily small |||]. But this is 
impossible, since by hypothesis /[y] has a minimum for y = J, i.e., 

AJ[h] = J[p + A] — JUV] > 0 

for all sufficiently small ||4||. This contradiction proves the theorem. 


The condition 5?/[h] > 0 is necessary but of course not sufficient for the 
functional J[y] to have a minimum for a given function. To obtain a 
sufficient condition, we introduce the following concept: We say that a 
quadratic functional [A] defined on some normed linear space ¥ is strongly 
positive if there exists a constant k > 0 such that 

Pah] > k|lAl|? 
for all /.* 


THEOREM 2. A sufficient condition for a functional J[y] to have a mini- 
mum for y = §, given that the first variation 8J[h] vanishes for y = f, 
is that its second variation 8°J[h] be strongly positive for y = S. 


Proof. For y = §, we have 5/[A] = 0 for all admissible 4, and hence 
AJA] = 8J[A}) + el[All?, 
where < -> 0 as |A|| > 0. Moreover, for y = f, 
SJ [A] > k |All’, 


where k = const > 0. Thus, for sufficiently small «1, |e| < $k if 
|A|| < e€,. It follows that 


AJ[h] = 82/[A] + ellhl|? > 4k Al? > 0 


if ||4|| < e,, ie, J[y] has a minimum for y = f, as asserted. 


4 In a finite-dimensional space, strong positivity of a quadratic form is equivalent to 
Positive definiteness of the quadratic form. Therefore, a function of a finite number of 
variables has a minimum at a point P where its first differential vanishes, if its second 
differential is positive at P. In the general case, however, strong positivity is a stronger 
condition than positive definiteness. 
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25. The Formula for the Second Variation. Legendre’s Condition 


Let F(x, y, z) be a function with continuous partial derivatives up to 
order three with respect to all its arguments. (Henceforth, similar smooth- 
ness requirements will be assumed to hold whenever needed.) We now 
find an expression for the second variation in the case of the simplest varia- 
tional problem, i.e., for functionals of the form 


& 
JD) = | Fe» y) dx, (4) 
defined for curves y = y(x) with fixed end points 


Wa)= A, yb) = B. 
First, we give the function y(x) an increment A(x) satisfying the boundary 
conditions 

h(a) = 0, h(b) = 0. (5) 


Then, using Taylor’s theorem with remainder, we write the increment of the 
functional J[y] as 


AJ[h) = J[y + A) - JL) 


b I poo a = (6) 
= [Fh + Fyhl) dx + 5 [° Fyyh?+ 2Fyyhh! + Fy yh?) dx, 


where, as usual, the overbar indicates that the corresponding derivatives are 
evaluated along certain intermediate curves, i.e., 


Fy, = Fy(x,y + 0h, y' + 04‘) (0 <6 < 1), 
and similarly for F,,- and F,,.,.. 
If we replace F,,, Fy, and Fy, by the derivatives F,,, Fy, and F,.,. eval- 
uated at the point (x, y(x), y‘(x)), then (6) becomes 


b b 
AJ [A] = [ (Fh + Fy’) dx + ; if (F,h? + 2Fyyhh' + Fyyh')dx +, (7) 
where « can be written as 
sb 
| (eh? + eghh’ + egh’?) dx. (8) 


Because of the continuity of the derivatives F,,, Fy, and F,.,-, it follows 
that €,, €2, ¢3 > Oas ||/'|, > 0, from which it is apparent that < is an infinites- 
imal of order higher than 2 relative to |A|/?. The first term in the right- 
hand side of (7) is 8J[A], and the second term, which is quadratic in A, is 


the second variation 37/[h]. Thus, for the functional (4) we have 


87J [A] = 5) 


b 
[ (Fy? + 2Fyyhh! + Fy yh") dx. (9) 
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We now transform (9) into a more convenient form. Integrating by parts 
and taking account of (5), we obtain 


6 ob 
[2k wht! dx = — J (5 Fy)? de 
Therefore, (9) can be written as 


sth] = [ ” (Ph'? + Qh) dx, (10) 


P=PQ)=5 Fry, 9 = 0) = (Fw - 5 Fw) (1) 


This is the expression for the second variation which will be used below. 

The following consequence of formulas (7) and (8) should be noted. If 
J(y] has an extremum for the curve y = p(x), and if y = y(x) + A(x) is an 
admissible curve, then 


Asta] = [° (Ph? + Oh?) de + f° Eh? + 9h’) dx, (12) 


where &, 1 > Oas ||A||, +0. In fact, since J[y] has an extremum for y = y(x), 
the linear terms in the right-hand side of (7) vanish, while the quantity (8) 
can be written in the form 


[Gi + nh!) ax 


by integrating the term e,hh’ by parts and using the boundary conditions (5). 
Formula (12) will be used later, when we derive sufficient conditions for a 
weak extremum (see Sec. 27). 

It was proved in Sec. 24 that a necessary condition for a functional J[y] to 
have a minimum is that its second variation 87/[h] be nonnegative. In the 
case of a functional of the form (4), we can use formula (10) to establish a 
necessary condition for the second variation to be nonnegative. The argu- 
ment goes as follows: Consider the quadratic functional (10) for functions 
A(x) satisfying the condition A(a@) = 0. With this condition, the function 
A(x) will be small in the interval [a, 5] if its derivative A’(x) is small in [a, 5]. 
However, the converse is not true, i.e., we can construct a function A(x) 
which is itself small but has a large derivative A’(x) in [a,b]. This implies 
that the term Ph’? plays the dominant role in the quadratic functional (10), 
in the sense that Ph’? can be much larger than the second term Qh? but it 
cannot be much smaller than Qh? (it is assumed that P # 0). Therefore, 
it might be expected that the coefficient P(x) determines whether the func- 
tional (10) takes values with just one sign or values with both signs. We now 
make this qualitative argument precise: 
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LEMMA. A necessary condition for the quadratic functional 
t) 

827 [h] = | (Ph'? + Qh?) dx, (13) 
defined for all functions h(x) € 2,(a, 6) such that h(a) = h(b) = 0, to be 
nonnegative is that 

P(x) 20 (@ex<d). (14) 
Proof. Suppose (14) does not hold, i.e., suppose (without loss of 
generality) that P(x») = —28 (8 > 0) at some point Xp in [a, 6]. Then, 
since P(x) is continuous, there exists an a > 0 such that a < xX) — a, 
Xp + « < b, and 
P(x) < — 8 (% —-%< xX <x + 2). 


We now construct a function A(x) € Z,(a, 6) such that the functional (13) 
is negative. In fact, let 


. 9 T(X — Xo) 
sin? ———_~ for x»-a<x<x+4, 
A(x) = rs . 4 (15) 
0 otherwise. 
Then we have 
is i tote on? . 4 2n(x — Xo) 
(Ph'? + Qh?) dx =| Pp sin? = * — *0) gy (16) 
‘a Io-@ a a 
Z, 4 — 2 
oe Q sint © — 90) gy < _ 2BE 5 oe, 
ZIo-@ 


where 
M = max |Q(x)j. 
a<cr<b 


For sufficiently small «, the right-hand side of (16) becomes negative, 
and hence (13) is negative for the corresponding function A(x) defined 
by(15). This proves the lemma. 


Using the lemma and the necessary condition for a minimum proved in 
Sec. 24, we immediately obtain 


THEOREM (Legendre). A necessary condition for the functional 


o 
JDI=[ Fy dx  Y@ =A, 6) = 8B 
to have a minimum for the curve y = y(x) is that the inequality 
Fyy 2 0 
(Legendre’s condition) be satisfied at every point of the curve. 


Legendre attempted (unsuccessfully) to show that a sufficient condition 
for J[y] to have a (weak) minimum for the curve y = p(x) is that the strict 
inequality 

Fyy > 0 (17) 
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(the strengthened Legendre condition) be satisfied at every point of the curve. 
His approach was to first write the second variation (10) in the form 


b 
S'y[A) = [ [Ph'? + 2whh’ + (Q + w')h?] dx, (18) 
where w(x) is an arbitrary differentiable function, using the fact that 
= 2 d 2 a : 14,2 U 
0 = | 5 (wh?) dx = | (wh? + 2whh!) dx, (19) 


since h(a) = h(b) = 0. Next, he observed that the condition (17) would 
indeed be sufficient if it were possible to find a function w(x) for which the 
integrand in (18) is a perfect square. However, this is not always possible, 
as was first shown by Legendre himself, since then w(x) would have to 
satisfy the equation 


P(Q + w’) = w?, (20) 


and although this equation is ‘‘locally solvable,” it may not have a solution 
in a sufficiently large interval.® 
Actually, the following argument shows that the requirement that 


Fyy[x, YX), ¥'()] > 0 (21) 


be satisfied at every point of an extremal y = y(x) cannot be a sufficient 
condition for the extremal to be a minimum of the functional J[y]. The 
condition (21), like the condition 


a 
dx 


characterizing the extremal is of a “local” character, i.e., it does not pertain 
to the curve as a whole, but only to individual points of the curve. Therefore, 
if the condition (21) holds for any two curves AB and BC, it also holds for 
the curve AC formed by joining 4B and BC. On the other hand, the fact 
that a functional has an extremum for each part AB and BC of some curve 
AC does not imply that it has an extremum for the whole curve AC. For 
example, a great circle arc on a given sphere is the shortest curve joining 
its end points if the arc consists of less than half a circle, but it is not the 
shortest curve (even in the class of neighboring curves) if the arc consists of 
more than half a circle. However, every great circle arc on a given sphere 
is an extremal of the functional which represents arc length on the sphere, 
and in fact it is easily verified that for this functional, (21) holds at every 
point of the great circle arc. Therefore, (21) cannot be a sufficient condition 


F,- = Fy =0 


5 For example, if P = —1, Q = 1, we obtain the equation w’ + | + w? = 0, so that 
w(x) = tan(c — x). If 6 — @> =, there is no solution in the whole interval [a, }], 
since then tan (¢c — x) must become infinite somewhere in [a, 6]. 
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for an extremum, nor, for that matter, can any set of purely local conditions 
be sufficient. 

Although the condition (20) does not guarantee a minimum, the idea of 
completing the square of the integrand in formula (18) for the second varia- 
tion, with the aim of finding sufficient conditions for an extremum, turns 
out to be very fruitful. In fact, the differential equation (20), which comes 
to the fore when trying to implement this idea, leads to new necessary 
conditions for an extremum (which are no longer local!). We shall discuss 
these matters further in the next two sections. 


26. Analysis of the Quadratic Functional iN (Ph’? + Qh?) dx 


As shown in the preceding section, to pursue our study of the ‘‘simplest”’ 
variational problem, i.e., that of finding the extrema of the functional 


JO = [Fos y 9) de, (22) 
where 
ya)=A, yd) =B, 
we have to analyze the quadratic functional® 


[ er? + ofA) ax, (23) 


defined on the set of functions A(x) satisfying the conditions 
h(a) =0, A(b)=0. (24) 


Here, the functions P and @Q are related to the function F appearing in the 
integrand of (22) by the formulas 


] 1 d 
LS 2 Fyy's Q= 5) (Fn ~ dx Fy) (25) 


For the time being, we ignore the fact that (23) is a second variation, satisfying 
the relations (25), and instead, we treat the analysis of (23) as an independent 
problem, in its own right. 

In the last section, we saw that the condition 


Pix) 20 (asx bd) 
is necessary but not sufficient for the quadratic functional (23) to be 20 
for all admissible /(x). In this section, it will be assumed that the strength- 
ened inequality 
P(x) > 0 (a<x< b) 


® Similarly, the study of extrema of functions of several variables (in particular, the 
derivation of sufficient conditions for an extremunt) involves the analysis of a quadratic 
form (the second differential). 
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holds. We then proceed to find conditions which are both necessary and 
sufficient for the functional (23) to be >0 for all admissible A(x) # 0, i-e., 
to be positive definite. We begin by writing the Euler equation 


Bis 
~ 4 (Ph) + Oh =0 (26) 


corresponding to the functional (23).? This is a linear differential equation 
of the second order, which is satisfied, together with the boundary conditions 
(24), or more generally, the boundary conditions 


h(a) = 0, h(c) = 0, (a<c< b), 


by the function A(x) = 0. However, in general, (26) can have other, non- 
trivial solutions satisfying the same boundary conditions. In this connection, 
we introduce the following important concept: 


DEFINITION. The point @ (#a) is said to be conjugate to the point a if 
the equation (26) has a solution which vanishes for x = a and x = @ but 
is not identically zero. 


Remark. If h(x) is a solution of (26) which is not identically zero and 
satisfies the conditions h(a) = h(c) = 0, then CA(x) is also such a solution, 
where C = const # 0. Therefore, for definiteness, we can impose some kind 
of normalization on A(x), and in fact we shall usually assume that the con- 
stant C has been chosen to make h(a) = 1.8 


The following theorem effectively realizes Legendre’s idea, mentioned on 
p. 104. 


THEOREM |. If 
P(Xx)>O0 (@<x< d), 


and if the interval [a, b] contains no points conjugate to a, then the quad- 
ratic functional 


b 
i} (Ph'? + Qh?) dx (27) 
is positive definite for all h(x) such that h(a) = h(b) = 0. 


7 It must not be thought that this is done in order to find the minimum of the functional 
(23). In fact, because of the homogeneity of (23), its minimum is either 0 if the func- 
tional is positive definite, or — oo otherwise. In the latter case, it is obvious that the 
minimum cannot be found from the Euler equation. The importance of the Euler 
equation (26) in our analysis of the quadratic functional (23) will become apparent in 
Theorem |. The reader should also not be confused by our use of the same symbol 
h(x) to denote both admissible functions, in the domain of the functional (23), and 
solutions of equation (26). This notation is convenient, but whereas admissible func- 
tions must satisfy A(a) = A(6) = 0, the condition A(6) = 0 will usually be explicitly 
precluded for nontrivial solutions of (26). 

8 If A(x) # 0 and A(a) = 0, then /’(a) must be nonzero, because of the uniqueness 
theorem for the linear differential equation (26). See e.g., E. A. Coddington, An 
Introduction to Ordinary Differential Equations, Prentice-Hall, Inc., Englewood Cliffs, 
New Jersey (1961), pp. 105, 260. 
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Proof. The fact that the functional (27) is positive definite will be 
proved if we can reduce it to the form 


[, PER) dx, 


where ¢(- - -) is some expression which cannot be identically zero unless 
h(x) = 0. To achieve this, we add a quantity of the form d(wh?) to the 
integrand of (27), where w(x) is a differentiable function. This will 
not change the value of the functional (27), since h(a) = h(b) = O implies 
that 


b 
J d(wh?) dx = 0 
(cf. equation (19)]. 
We now select a function w(x) such that the expression 
Ph? + Oh? + us (wh?) = Ph’? + 2whh’ + (Q + w')h? (28) 
is a perfect square. This will be the case if w(x) is chosen to be a 
solution of the equation 
P(Q + w’) = w? (29) 
(cf. equation (20)]. In fact, if (29) holds, we can write (28) in the form 
pee Wie 
P(h % ph) 


Thus, if (29) has a solution defined on the whole interval (a, 5], the quad- 
ratic functional (27) can be transformed into 


b w 2 
il P(Hi + py) dx, (30) 


and is therefore nonnegative. 
Moreover, if (30) vanishes for some function h(x), then obviously 


h(x) + 5H) = 0, (31) 


since P(x) > O for a = x = Bb. Therefore the boundary condition 
h(a) = 0 implies h(x) = 0, because of the uniqueness theorem for 
the first-order differential equation (31). It follows that the functional 
(30) is actually positive definite. 

Thus, the proof of the theorem reduces to showing that the absence of 
points in [a, b] which are conjugate to a guarantees that (29) has a solution 
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defined on the whole interval [a, b]. Equation (29) is a Riccati 
equation, which can be reduced to a linear differential equation of the 
second order by making a change of variables. In fact, setting 


, 


u 
w= - <P, (32) 


where uw is a new unknown function, we obtain the equation 
~ 4 (py) + Qu=0 (33) 
dx" = 


which is just the Euler equation (26) of the functional (27). If there are 
no points conjugate to a in [a, b], then (33) has a solution which does not 
vanish anywhere in [a, b],° and then there exists a solution of (29), 
given by (32), which is defined on the whole interval [a, b]. This com- 
pletes the proof of the theorem. 


Remark. The reduction of the quadratic functional (27) to the form (30) 
is the continuous analog of the reduction of a quadratic form to a sum of 
squares. The absence of points conjugate to a in the interval [a, b] is the 
‘analog of the familiar criterion for a quadratic form to be positive definite. 
This connection will be discussed further in Sec. 30. 

Next, we show that the absence of points conjugate to a in the interval 
[a, b] is not only sufficient but also necessary for the functional (27) to be 
positive definite. 


Lemma. If the function h = h(x) satisfies the equation 
dk, = 
Beer (Ph') + Qh =0 


and the boundary conditions 


h(a) = h(b) = 0, (34) 
then 


b 
i (Ph'? + Qh?) dx = 0. 
Proof. The lemma is an immediate consequence of the formula 
o={" [- 4 (phy + nls dx = [° (PH? + Qh?) dx 
= a dx - a : 
which is obtained by integrating by parts and using (34). 


° If the interval [a, 5] contains no points conjugate to a, then, since the solution of the 
differential equation (26) depends continuously on the initial conditions, the interval 
[a, 6] contains no points conjugate to a — ec, for some sufficiently small «. Therefore, 
the solution which satisfies the initial conditions A(a — e) = 0, A’(a — €) = 1 does not 
vanish anywhere in the interval [a, 5]. Implicit in this argument is the assumption that 
P does not vanish in [a, 8]. 
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THEOREM 2. If the quadratic functional 


[ en + on) dx, (35) 
where 
P(x) > 0 (a<x< by), 


is positive definite for all h(x) such that h(a) = h(b) = 0, then the interval 
[a, 5] contains no points conjugate to a. 


Proof. The idea of the proof is the following: We construct a family 
of positive definite functionals, depending on a parameter ¢, which for 
t = 1 gives the functional (35) and for ¢ = 0 gives the very simple 
quadratic functional 


i h’? dx, 


for which there can certainly be no points in [a, 5] conjugate to a. 
Then we prove that as the parameter f¢ is varied continuously from 0 
to 1, no conjugate points can appear in the interval [a, 5). 

Thus, consider the functional 


(i [t(Ph’? + Qh?) + (1 — 1)h'?] dx, (36) 


which is obviously positive definite for all 1 O<t<_ 1, since (35) 
is positive definite by hypothesis. The Euler equation corresponding to 
(36) is 


- 4 (UP + (1 — jr} 4+ ¢Qh =0. (37) 


Let A(x, 1) be the solution of (37) such that A(a, t) = 0, Aa, t) = 1 for 
allr,O0 <4¢< 1. This solution is a continuous function of the parameter 
t, which for ¢ = 1 reduces to the solution A(x) of equation (26) satisfying 
the boundary conditions /(a) = 0, h’(a) = 1, and for t = O reduces to the 
solution of the equation h” = 0 satisfying the same boundary conditions, 
i.e., the function A = x —a. We note that if A(x, fo) = 0 at some 
point (x9, fo), then A,(xo, fo) # 0. In fact, for any fixed ¢, A(x, f) satisfies 
(37), and if the equations (x9, fo) = 0, A(Xo, fo) = O were satisfied simul- 
taneously, we would have /(x, fo) = 0 for all x, a < x < 5b, because of 
the uniqueness theorem for linear differential equations. But this is 
impossible, since f(a, t) = 1 forall *,O <t <1. 

Suppose now that the interval [a,b] contains a point @ conjugate 
to a, i.e., suppose that (x, 1) vanishes at some point x = d@ in [a, 5]. 
Then @ # 8, since otherwise, according to the lemma, 


[" (Ph? + Oh?) dx = 0 


for a function /(x) # 0 satisfying the conditions A(a) = (6) = 0, 
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which would contradict the assumption that the functional (35) is positive 
definite. Therefore, the proof of the theorem reduces to showing that 
(a, b] contains no interior point @ conjugate to a. 





FIGURE 7 


To prove this, we consider the set of all points (x, t),a < x < 5, 
satisfying the condition A(x, t)=0.1° This set, if it is nonempty, 
represents a curve in the xf-plane, since at each point where A(x, t) = 0, 
the derivative A,(x, ft) is different from zero, and hence, according to the 
implicit function theorem, the equation A(x, t) = 0 defines a continuous 
function x = x(t) in the neighborhood of each such point.!! By 
hypothesis, the point (4, 1) lies on this curve. Thus, starting from the 
point (4, 1), the curve (see Figure 7) 


A. Cannot terminate inside the rectangle a< x < 6,0 <t< 1, 
since this would contradict the continuous dependence of the 
solution A(x, t) on the parameter f; 


B. Cannot intersect the segment x = 6,0 < ¢ < 1, since then, by 
exactly the same argument as in the lemma [but applied to equation 
(37), the boundary conditions h(a, t) = h(6, t) = 0 and the func- 
tional (36)], this would contradict the assumption that the functional 
is positive definite for all ¢; 


C. Cannot intersect the segment a < x < 6,t = 1, since then for 
some ¢ we would have A(x, t) = 0, A,(x, t) = 0 simultaneously; 


D. Cannot intersect the segment a < x < 6b, t = 0, since for 
t = 0, equation (37) reduces to h” = 0, whose solutiond = x — a 
would only vanish for x = a; 


E. Cannot approach the segment x = a,0 < ¢ < 1, since then for 
some ft we would have h,(a, 1) = 0 [why?], contrary to hypothesis. 


10 Recall that A(a,t) = Oforallr,O <r <1. 
11 See e.g., D. V. Widder, op. cit., p. 56. See also footnote 8, p. 47. 
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It follows that no such curve can exist, and hence the proof is 
complete. 


If we replace the condition that the functional (35) be positive definite 
by the condition that it be nonnegative for all admissible A(x), we obtain 
the following result: 


THEOREM 2'. If the quadratic functional 


[ en? + on) dx (38) 


where 
P(x) > 0 (a<x<b) 


is nonnegative for all h(x) such that h(a) = h(b) = 0, then the interval 
[a, 6] contains no interior points conjugate to a.'? 


Proof. If the functional (38) is nonnegative, the functional (36) is 
positive definite for all t except possibly tf = |. Thus, the proof of 
Theorem 2 remains valid, except for the use of the lemma to prove that 
& = b is impossible. Therefore, with the hypotheses of Theorem 2’, 
the possibility that @ = 6 is not excluded. 


Combining Theorems | and 2, we finally obtain 
THEOREM 3. The quadratic functional 
o 
i) (Ph? + Qh?) dx, 


where 
Pix)>O0 (a<x< 5b), 


is positive definite for all h(x) such that h(a) = h(b) = 0 if and only if 
the interval [a, 6] contains no points conjugate to a. 


27. Jacobi’s Necessary Condition. More on Conjugate Points 


We now apply the results obtained in the preceding section to the simplest 
variational problem, i.e., to the functional 


is F(x, y, y') dx (39) 
with the boundary conditions 
ya)= A, Yb) = B. 
12 In other words, the solution of the equation 
—4 (Pr) + Qh=0 


satisfying the initial conditions A(a) = 0, 4’(a) = 1 does not vanish at any interior point 
of the interval [a, 4]. 
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It will be recalled from Sec. 25 that the second variation of the functional 
(39) [in the neighborhood of some extremal y = y(x)] is given by 


o 
| (Ph'? + Qh?) dx (40) 
where 
1 1 d 
P=Fy, Q=4 (A; ~£ Fry) (41) 
DEFINITION |. The Euler equation 
d i ps 
ae (Ph') + Qh =0 (42) 


of the quadratic functional (40) is called the Jacobi equation of the original 
functional (39). 


DEFINITION 2. The point & is said to be conjugate to the point a with 
respect to the functional (39) if it is conjugate to a with respect to the 
quadratic functional (40) which is the second variation of (39), (.e., if it 
is conjugate to a in the sense of the definition on p. 106. 


THEOREM (Jacobi’s necessary condition). If the extremal y = y(x) 
corresponds to a minimum of the junctional 


eb 
| Fos yy) dx, 


and if 
Fyy > 0 


along this extremal, then the open interval (a, 6) contains no points con- 
jugate to a3 


Proof. In Sec. 24 it was proved that nonnegativity of the second 
variation is a necessary condition fora minimum. Moreover, according 
to Theorem 2’ of Sec. 26, if the quadratic functional (40) is nonnegative, 
the interval (a, 5) can contain no points conjugate to a. The theorem 
follows at once from these two facts taken together. 


We have just defined the Jacobi equation of the functional (39) as the Euler 
equation of the quadratic functional (40), which represents the second 
variation of (39). We can also derive Jacobi’s equation by the following 
argument: Given that y = y(x) is an extremal, let us examine the conditions 
which have to be imposed on /(x) if the varied curve y = y*(x) = p(x) + A(x) 
is to be an extremal also. Substituting y(x«) + A(x) into Euler’s equation 


Fix, y + hy y’ + hr’) - - F(xyythy+h)=0, 


13 Of course, the theorem remains true if we replace the word “minimum” by 
“maximum” and the condition Fy, > 0 by Fy, < 0. 
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using Taylor’s formula, and bearing in mind that y(x) is already a solution 
of Euler’s equation, we find that 


Fyh + Fyyh' — F (Fh + Fyyh') = o(h), 


where o(A) denotes an infinitesimal of order higher than 1 relative to A and 
its derivative. Neglecting o(f) and combining terms, we obtain the linear 
differential equation 


d d Ren 
(F,, — FF h — Gy rv’) = 0; 


this is just Jacobi’s equation, which we previously wrote in the form (42), 
using the notation (41). In other words, Jacobi’s equation, except for infini- 
tesimals of order higher than 1, is the differential equation satisfied by the 
difference between two neighboring (i.e., “infinitely close”) extremals. An 
equation which is satisfied to within terms of the first order by the 
difference between two neighboring solutions of a given differential equation 
is called the variational equation (of the original differential equation). 
Thus, we have just proved that Jacobi’s equation is the variational equation of 
Euler’s equation. 


Remark. These considerations are easily extended to the case of an 
arbitrary differential equation 


F(x, y, y’,...,¥”) = 0 (43) 


of order n. Let y(x) and y(x) + 5y(x) be two neighboring solutions of (43). 
Replacing y(x) by »(x) + 5y(x) in (43), using Taylor’s formula, and bearing 
in mind that )(x) satisfies (43), we obtain 


F,8y + Fy(8y)' + +++ + Fym(8yy + ¢ = 0, 


where « denotes a remainder term, which is an infinitesimal of order higher 
than | relative to 8y and its derivatives. Retaining only terms of the first 
order, we obtain the linear differential equation 


F,3y + Fy(8y)' + --» + Fyr8y)™ = 0, 


satisfied by the variation Sy; as before, this equation is called the variational 
equation of the original equation (43). For initial conditions which are 
sufficiently close to zero, this equation defines a function which is the 
principal linear part of the difference between two neighboring solutions of 
(43) with neighboring initial conditions. 


We now return to the concept of a conjugate point. It will be recalled 
that in Sec. 26 the point @ was said to be conjugate to the point a if A(@) = 0, 
where A(x) is a solution of Jacobi’s equation satisfying the initial conditions 
h(a) = 0, h'(a) = 1. As just shown, the difference z(x) = y*(x) — y(x) 
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corresponding to two neighboring extremals y = y(x) and y = y*(x) drawn 
from the same initial point must satisfy the condition 


- Z (pe) + Oz = 02), 


where o(z) is an infinitesimal of order higher than | relative to z and its 
derivative. Hence, to within such an infinitesimal, y*(x) — y(x) is a nonzero 
solution of Jacobi’s equation. This leads to another definition of a con- 
jugate point:1* 

DEFINITION 3. Given an extremal y = y(x), the point M = (4, y(a)) 
is said to be conjugate to the point M = (a, y(a)) if at M the difference 
y*(x) — y(x), where y = y*(x) is any neighboring extremal drawn from 
the same initial point M, is an infinitesimal of order higher than | relative 
to || y*(x) — Y(x)I|1.- 

Still another definition of a conjugate point is possible: 


DEFINITION 4. Given an extremal y = y(x), the point M = (4, y(4)) 
is said to be conjugate to the point M = (a, y(a)) if M is the limit as 
| y*(x) — y(x)|,— 0 of the points of intersection of y = y(x) and the 
neighboring extremals y = y*(x) drawn from the same initial point M. 


It is clear that if the point M/ is conjugate to the point M in the sense of 
Definition 4 (i.e., if the extremals intersect in the way described), then ‘7 is 
also conjugate to M in the sense of Definition 3. We now verify that the 
converse is true, thereby establishing the equivalence of Definitions 3 and 4. 
Thus, let y = (x) be the extremal under consideration, satisfying the initial 
condition 

Wa) = A, 
and let y*(x) be the extremal drawn from the same initial point M = (a, A), 
satisfying the condition 
ye (a) — y'(a) = «. 
Then y*(x) can be represented in the form 
Valx) = y(x) + ah(x) + ¢, 
where A(x) is a solution of the appropriate Jacobi equation, satisfying the 
conditions 
h(a) = 0, h(a) = 1, 

and « is a quantity of order higher than | relative to «. 

Now let 


ha@)=0, B= J 


14Jn stating this definition, we enlarge the meaning of a conjugate point to apply 
to points lying on an extremal and not just their abscissas. In all these consideralions, 
it is tacitly assumed that P = }F,.,- has constant sign along the given extremal y = y(x). 
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It is clear that A’(@) # 0, since A(x) # 0. Using Taylor’s formula, we can 
easily verify that for sufficiently small «, the expression 


yalx) — p(x) = ah(x) + € 


takes values with different signs at the points @—-f and @+ 8. Since 
8—>0 as a0, this means that Af = (4, )(4)) is the limit as « > 0 of the 
points of intersection of the extremals y = y*(x) and the extremal y = y(x). 


Example. Consider the geodesics on a sphere, i.e., the great circle arcs. 
Each such arc is an extremal of the functional which gives arc length on the 
sphere. The conjugate of any point M on the sphere is the diametrically 
opposite point MM. In fact, given an extremal, a// extremals with the same 
initial point M (and not just the neighboring extremals) intersect the given 
extremal at M. This property stems from the fact that a sphere has con- 
stant curvature, and is no longer true if the sphere is replaced by a “‘neigh- 
boring” ellipsoid (for example). 


We conclude this section by summarizing the necessary conditions for an 
extremum found so far: If the functional 


[ Fosxx)dx, (a) = A, 0) = B 


has a weak extremum for the curve y = p(x), then 


1. The curve y = y(x) is an extremal, i.e., satisfies Euler’s equation 


(see Sec. 4); 


2 Along the curve y = y(x), Fyy 2 0 for a minimum and F,,, < 0 for 
a maximum (see Sec. 25); 


3. The interval (a, 6) contains no points conjugate to a (see Sec. 27). 


28. Sufficient Conditions for a Weak Extremum 


In this section, we formulate a set of conditions which is sufficient for a 
functional of the form 


IDI =f Fes yx)dx = A, 0) = B (44) 


to have a weak extremum for the curve y = y(x). It should be noted that 
the sufficient conditions to be given below closely resemble the necessary 
conditions given at the end of the preceding section. The necessary con- 
ditions were considered separately, since each of them is necessary by itself. 
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However, the sufficient conditions have to be considered as a set, since the 
presence of an extremum is assured only if all the conditions are satisfied 
simultaneously. 


THEOREM. Suppose that for some admissible curve y = y(x), the 
functional (44) satisfies the following conditions: 


1. The curve y = y(x) is an extremal, i.e., satisfies Euler’s equation 
d 
Fy, - ax 

2. Along the curve y = y(x), 
P(x) = HFyy[x, x(x), y'Q)] > 0 


(the strengthened Legendre condition); 


Fy = 0; 


3. The interval [a, b] contains no points conjugate to the point a (the 
strengthened Jacobi condition).'° 


Then the functional (44) has a weak minimum for y = y(x). 


Proof. If the interval [a, 5) contains no points conjugate to a, and if 
P(x) > 0 in [a, 6], then because of the continuity of the solution of 
Jacobi’s equation and of the function P(x), we can find a larger interval 
[a, 6 + e] which also contains no points conjugate to a, and such that 
P(x) > Oin [a,b + «]. Consider the quadratic functional 


[ (eh? + On) dx — a? [ h’? de, (45) 
with the Euler equation 
e * [(P — 02)h'] + Oh =0. (46) 


Since P(x) is positive in [a, 5 + e«] and hence has a positive (greatest) 
lower bound on this interval, and since the solution of (46) satisfying the 
initial conditions A(a) = 0, A’(0) = 1 depends continuously on the 
parameter « for all sufficiently small «, we have 


lL P(x) «2 >Oa<x<b; 


2. The solution of (46) satisfying the boundary conditions A(a) = 0, 
h'(a) = | does not vanish fora < x < b. 


As shown in Theorem | of Sec. 26, these two conditions imply that the 
quadratic functional (45) is positive definite for all sufficiently small «. 
In other words, there exists a positive number c > 0 such that 


i ” (Ph’? + Qh?) dx > c i "Re de. (47) 


18 The ordinary Jacobi condition states that the open interval (a, 5) contains no points 


conjugate to a. Cf. Jacobi’s necessary condition, p. 112. 
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It is now an easy consequence of (47) that a minimum is actually 
achieved for the given extremal. In fact, if y = y(x) is the extremal 
and y = y(x) + A(x) is a sufficiently close neighboring curve, then, 
according to formula (12) of Sec. 25, 


Jly + A] - Jy] = | ” (PH? + Qh?) dx + if (Eh? + nh'?) dx, (48) 


where €(x), 4(x) > 0 uniformly for a < x < 6 as ||A||,-> 0. Moreover, 
using the Schwarz inequality, we have 


jae ( [in dx) < (x - a) fH? dx < (x - a) [. h? dx, 


i.€., 


= + a 
[wax Cae | a? de, 


which implies that 


| f ” (Eh? + ah?) dx 





Ze (1 + eo) iN h’? dx (49) 


if |€(x)| < ¢, [n(*)| < « Since « > 0 can be chosen to be arbitrarily 
small, it follows from (47) and (49) that 


Jy + Al —Jpl = [ (Ph’? + Qh?) dx + ie (Zh? + yh) dx > 0 


for all sufficiently small ||All,. Therefore, the extremal y = y(x) 
actually corresponds to a weak minimum of the functional (44), in some 
sufficiently small neighborhood of y = y(x). This proves the theorem, 
thereby establishing sufficient conditions for a weak extremum in the 
case of the “‘simplest” variational problem. 


29. Generalization to n Unknown Functions 


The concept of a conjugate point and the related Jacobi conditions can 
be generalized to the case where the functional under consideration depends 
on n functions y,(x),..., ¥,(x). In this section we carry over to such 
functionals the definitions and results given earlier for functionals depend- 
ing on a single function. To keep the notation simple, we write 


JU] = f° Fes yy) dx (50) 


as before, where now y denotes the n-dimensional vector (y,,..., y,) and y’ 
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the n-dimensional vector (y;,...,¥n) [cf. Sec. 20]. By the scalar product 
(y, 2) of two vectors 


Y= (n---> Vas 22 (Ziysieres Za) 
we mean, as uSual, the quantity 


y, z) = y121 + ote + VnZp. 


Whenever the transition from the case of a single function to the case of n 
functions is straightforward, we shall omit details. 


29.1. The second variation. The Legendre condition. If the increment 


AJA] of the functional (50), corresponding to the change from y to y + h,1® 
can be written in the form 


AJ{h] = gifh] + palh] + &llAl]?, 


where 9 [A] is a linear functional, 9.[h] is a quadratic functional, and «> 0 
as ||h|| + 0, then 9[A] is called the second variation of the original functional 
(50) and is denoted by 8°J[A].’”__ In the case of fixed end points, where 


h(a)=h(b)=0 (=1,...,n), 
or more concisely, 
h(a) = h(b) = 0, 


we easily find, applying Taylor’s formula, that the second variation of (50) 
is given by 


1 4 1 { 


Fy] dx. (51) 


1 
Introducing the matrices 
Fy = Fuv. || Fy = I Fave, Fyy = Five (52) 
we can write (51) in the compact form 
b 
BUT = 5 | WFvhs A) + Fh, Hh) + Frvh',hdx, (53) 
where each term in the integrand is the scalar product of the vector / or f’ 


and the vector obtained by applying one of the matrices (52) to A or h’. 
Then, integrating by parts, we can reduce (53) to the form 


b 
[ (PAY, #) + (Qh, A) ax, (54) 
16 The letter A denotes the vector (fi,...., An), and ||4|| means 


>, max (AG)! + 1h GO1} = 2 Wala. 


17 Obviously, p,[A] is the (first) variation of the functional (50). 
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where P = P(x) and Q = Q(x) are the matrices 
1 1 d 
P=[Pul=3 Fr,  2=1Oull = 3 (Fu — 3 Fo): 


In deriving (54), we assume that F,, is a symmetric matrix,!® i.e., that 
Fyy, = Fy y. for alli, kK =1,..., (F,, and Fy, are automatically sym- 
metric, because of the tacitly assumed smoothness of F). Just as in the case 
of one unknown function, it is easily verified that the term (Ph’,h’) makes 
the ‘‘main contribution” to the quadratic functional (54). More precisely, 
we have the following result: 


THEOREM |. A necessary condition for the quadratic functional (54) to 
be nonnegative for all h(x) such that h(a) = h(b) = 0 is that the matrix P 
be nonnegative definite.” 


29.2. Investigation of the quadratic functional (54), As in Sec. 26, we can 
investigate the functional (54) without reference to the original functional 
(50), assuming, however, that P and Q are symmetric matrices. As before 
(see Sec. 26), we begin by writing the system of Euler equations 


d n ; n 
— FD, Pui + D, Oud = 0 (k =1,...,0), (55) 
1=1 1=1 


corresponding to the functional (54). The equations (55) can be written 


more concisely as d 
— FPA) + Oh = 0, (56) 


in terms of the matrices P and Q. 


DEFINITION 1. Let 
ho = (Ay, hyo, sty hyn); 
h® = (hai, hoo, aa | han)s 67) 


h™ = (har, Anas» » Ann) 


be a set of n solutions of the system (55), where the ith solution satisfies 


the initial conditions®® 
h;,(a) = 0 (kK = 1,...,”) (58) 


h(a) = 1, hi,{a) = 0 (k # i). (59) 


*® Without this assumption, which is unnecessarily restrictive, equations (54) and (55) 
become more complicated, but it can be shown that Theorems | and 2 remain valid 
(H. Niemeyer, private communication). 

* This is the appropriate multidimensional generalization of the Legendre condition 
(14), p. 103. The matrix P = P(x) is said to be nonnegative definite (positive definite) 
if the quadratic form 


and 


> Pulxa(xadx) (a <x <d) 
i,k=1 
is nonnegative (positive) for all x in [a, 6) and arbitrary h,(x), ..., Ana(x). 
> Thus, the vectors 4(a@) are the rows of the zero matrix of order n, and the vectors 
h(a) are the rows of the unit matrix of order n. 
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Then the point ad (#a) is said to be conjugate to the point a if the deter- 
minant 
hyy(x) Ayal) «++ Ain) 


hoy (x) hoo(x) + +> Aon 
(x) Aza(x) (x) (60) 


har (x) Ay2(x) po Aan(x) 
vanishes for x = G. 


THEOREM 2. If P is a positive definite symmetric matrix, and if the inter- 
val [a, b] contains no points conjugate to a, then the quadratic functional 
(54) is positive definite for all h(x) such that h(a) = h(b) = 0. 

Proof. The proof of this theorem follows the same plan as the proof 
of Theorem | of Sec. 26. Let W be an arbitrary differentiable sym- 
metric matrix. Then 


od Beas b , 
0= | (Wh hy dx = | (Wh hydx +2 (Wh, h’) dx 


for every vector A satisfying the boundary conditions (58). Therefore, 
we can add the expression 


(W'h, h) + 2(WAh, h') 
to the integrand of (54), obtaining 


ia [(Ph’, h’) + 2(WA, h') + (Qh, h) + (W'h, h)\ dx, (61) 


without changing the value of (54). 

We now try to select a matrix W such that the integrand of (61) is a 
perfect square. This will be the case if W is chosen to be a solution of 
the equation”? 


Q+ W' = WP-W, (62) 


which we call the matrix Riccati equation (cf. p. 108). In fact, if we 
use (62), the integrand of (61) becomes 


(Ph', h’) + 2(Wh, h’) + (WP- WA, h). (63) 


Since P is a positive definite symmetric matrix, the square root P!/? 
exists, is itself positive definite and symmetric, and has the inverse 
P 12. Therefore, we can write (63) as the “perfect square” 


(P22h' + P-¥2 Wh, PY’ + P-¥2Wh). 


[Recall that if T is a symmetric matrix, (Ty, z) = (y, Tz) for any 
vectors y and z.]_ Repeating the argument given in the case ofa scalar 
function / (see p. 107), we can show that 
PU2h! + P-U2Wh 
**It can be shown that this is compatible with W being symmetric, even when Fyy- 
fails to be symmetric and (62) is replaced by a more general equation (H. Niemeyer, 
private communication). 
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cannot vanish for all x in [a, 6] unless A = 0. It follows that if the 
matrix Riccati equation (62) has a solution W defined on the whole 
interval [a, 5], then, with this choice of W, the functional (61), and hence 
the functional (54), is positive definite. 

Thus, the proof of the theorem reduces to showing that the absence 
of points in [a, 6] which are conjugate to a guarantees that (62) has a 
solution defined on the whole interval [a, 6]. Making the substitution 


W = —PU'U"} (64) 


in (62), where U is a new unknown matrix [cf. (32)], we obtain the 
equation 


~ 4 (pu) + Qu =0, (65) 


which is just the matrix form of equation (56). The solution of (65) 
satisfying the initial conditions 


u0)=98 UO =L 


where 6 is the zero matrix and / the unit matrix of order n, is precisely 
the set of solutions (57) of the system (55) which satisfy the initial 
conditions (58) and (59) [cf. footnote 19, p. 119]. If [a, b] contains 
no points conjugate to a, we can show that (65) has a solution U(x) 
whose determinant does not vanish anywhere in [a, b),?* and then 
there exists a solution of (62), given by (64), which is defined on the 
whole interval [a, 6]. In other words, we can actually find a matrix W 
which converts the integrand of the functional (61) into a perfect square, 
in the way described. This completes the proof of the theorem. 


Next we show, as in Sec. 26, that the absence of points conjugate to a 
in the interval [a, 5] is not only sufficient but also necessary for the functional 
(53) to be positive definite. 


Lemma. If 
A(x) = (AQ), . - -, An()) 


satisfies the system (55) and the boundary conditions 


h(a) = h(b) = 0, (66) 
then 


[ (Pe, ny + (Qh, W)) dx = 0. 





2 The fact that det P does not vanish in [a, 5] is tacitly assumed, but this is guaranteed 
by the positive definiteness of P (cf. footnote 9, p 108). 
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Proof. The lemma is an immediate consequence of the formula 
b d ‘ _ 7 xfs 
0 = ib (- qx (PR) + Qh, n) dx = i [((Ph', h’) + (Qh, h)] dx, 


which is obtained by integrating by parts and using (66). 


THEOREM 3. If the quadratic functional 
b 
[ Wea, Hy + (Qh, hy) ax, (67) 


where P is a positive definite symmetric matrix, is positive definite for 
all h(x) such that h(a) = h(b) = 0, then the interval {a, b] contains no 
points conjugate to a. 


Proof. The proof of this theorem follows the same plan as the proof 
of the corresponding theorem for the case of one unknown function 
(Theorem 2 of Sec. 26). We consider the positive definite quadratic 
functional 


[, eter, m+ (Oh, M+ = MAY dx (68) 


The system of Euler equations corresponding to (68) is 
d n ; , n 
ae [+ > Padi +(1- hi + i> On = 90 (K=1,...,n) (69) 
{=1 1=1 


(cf. (37)], which for t = 1 reduces to the system (55), and for t = 0 
reduces to the system 


Ae=0 (k=1,...,0). 


Suppose the interval [a, b] contains a point & conjugate to g, i.e., suppose 
the determinant (60) vanishes for x = @. Then there exists a linear 
combination A(x) of the solutions (57) which is not identically zero such 
that A(@) = 0. Moreover, there exists a nontrivial solution A(x, t) of 
the system (69) which depends continuously on ¢ and reduces to A(x) 
fort = 1. Itisclear that d # 5, since otherwise, according to the lemma, 
the positive definite functional (67) would vanish for A(x) # 0, which 
is impossible. The fact that @ cannot be an interior point of [a, 5] is 
proved by the same kind of argument as used in Theorem 2 of Sec. 26, 
for the case of a scalar function A(x). Further details are left to the 
reader. 


Suppose now that we only require that the functional (67) be nonnegative. 
Then, by the same argument as used to prove Theorem 2’ of Sec. 26, we have 


THEOREM 3’. If the quadratic functional 


[ cen, #) + (Oh, AN dx, 
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where P is a positive definite symmetric matrix, is nonnegative for all h(x) 
such that h(a) = h(b) = 0, then the interval [a, b] contains no interior 
points conjugate to a. 


Finally, combining Theorems 2 and 3, we obtain 


THEOREM 4. The quadratic functional 
b 
[ (PA, A) + (Oh, AN) dx, 


where P is a positive definite symmetric matrix, is positive definite for all 

h(x) such that h(a) = h(b) = 0 if and only if the interval a, b] contains 

no point conjugate to a. 

29.3. Jacobi’s necessary condition. More on conjugate points. We now 
apply the results just obtained to the original functional 


b 
Jbl=[ Fey yds ya)= Mo, ¥(b)= Mi, (70) 
where M, and M, are two fixed points, recalling that the second variation of 
(70) is given by 
b 
[ (Pr, #) + (Qh, A) dx, (71) 


where 


1 d 
P=sFw, 0=3(Fw-z Fy): (72) 


DEFINITION 2. The system of Fuler equations 


d n ; n 
= FD Pudi + D Quy = 0 (k =1,...,0), 
i=i i=i 


or more concisely 
d : = 
oe (Ph') + Qh = 0, (73) 


of the quadratic functional (71) is called the Jacobi system of the original 
functional (70). 23 


DEFINITION 3. The point @ is said to be conjugate to the point a with 
respect to the functional (70) if it is conjugate to a with respect to the 
quadratic functional (71) which is the second variation of the functional 
(70), i.e., if it is conjugate to ain the sense of Definition 1, p. 119. 


Since nonnegativity of the second variation is a necessary condition for 
the functional (70) to have a minimum (see Theorem | of Sec. 24), Theorem 3’ 
immediately implies 


2 Equations (70)-(73) closely resemble equations (39)-(42) of Sec. 27, except that 
h, h’ are now vectors, and P, Q are now matrices. 
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THEOREM 5 (Jacobi’s necessary condition). If the extremal 


y= Vr), - + +5 Yn = Ya(x) 


corresponds to a minimum of the functional (70), and if the matrix 


Fy y[x, V(x), y')) 


is positive definite along this extremal, then the open interval (a, b) contains 
no points conjugate to a. 


So far, we have said that the point @ is conjugate to a if the determinant 
formed from n linearly independent solutions of the Jacobi system, satisfying 
certain initial conditions, vanishes for x = 4@. As in the case n = 1, this 
basic definition is equivalent to two others, which involve only extremals of 
the functional (70), and not solutions of the Jacobi system: 


DEFINITION 4. Suppose n neighboring extremals 
Vr = Vial), ---5 Va = Vinal) (i= 1,..., 4”) 


start from the same n-dimensional point, with directions which are close 
together but linearly independent. Then the point @ is said to be conjugate 
to the point a if the value of the determinant 


Vis) Yielx) Yinlx) 
Ya(xX) Yo2(x) Yan(x) 
Vni(x) Vn2lX) Yan(X) 


for x = G@ is an infinitesimal whose order is higher than that of its values 
fora<x <4. 


In the next definition, we enlarge the meaning of a conjugate point to 
apply to points lying on extremals (cf. footnote 14, p. 114). 
DEFINITION 5. Given an extremal y with equations 
ya Yi(x); ses Va =F yrlX), 
the point 
M = (4, yi(4), eae } yn(@)) 
is said to be conjugate to the point 
M= (a, yi(a), oe) y,(a)) 


if y has a sequence of neighboring extremals drawn from the same initial 
point M, such that each neighboring extremal intersects y and the points 
of intersection have M as their limit. 


The equivalence of all these definitions of a conjugate point is proved by 
using considerations similar to those given for the case of a single unknown 
function (see Sec. 27). 
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29.4. Sufficient conditions for a weak extremum. Theorem 2 and an 
argument like that used to prove the corresponding theorem of Sec. 28 
(for the scalar case) imply 


THEOREM 6. Suppose that for some admissible curve y with equations 
y= yi(x), son = Ya(x); 
the functional (70) satisfies the following conditions: 


1. The curve y is an extremal, i.e., satisfies the system of Euler equations 
Fy, =0 G=1,...,n); 


2. Along y the matrix 
P(x) = 4Fyy Lx, vx), »')] 
is positive definite; 
3. The interval [a, b] contains no points conjugate to the point a. 


Then the functional (70) has a weak minimum for the curve y. 


30. Connection between Jacobi’s Condition and the Theory of 
Quadratic Forms” 


According to Theorem 3 of Sec. 26, the quadratic functional 


[ene + on) dx, (74) 


where 
P(x) > 0 (a<x<b), 


is positive definite for all A(x) such that A(a) = A(b) = 0 if and only if the 
interval [a,b] contains no points conjugate to a.25 The functional (74) 
is the infinite-dimensional analog of a quadratic form. Therefore, to obtain 
conditions for (74) to be positive definite, it is natural to start from the 
conditions for a quadratic form defined on an n-dimensional space to be 
positive definite, and then take the limit as 1 > o. 

This may be done as follows: By introducing the points 


@ = Xo, Xy, +++) Xn Xng = 4, 
we divide the interval [a, b] into n + 1 equal parts of length 
_b-a 
n+] 





Ax = X41 — (= 0,1,..., 7). 


** Like Sec. 29, this section is written in a somewhat more concise style thanthe rest of 
the book, and can be omitted without loss of continuity. 
28 This is the strengthened Jacobi condition (see p. 116). 
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Then we consider the quadratic form 
< Iyaa — Ay\? 
> [P(A + one] ox, (75) 


where P,, Q, and /, are the values of the functions P(x), Q(x) and A(x) at 
the point x = x, This quadratic form is a “finite-dimensional approxi- 
mation” to the functional (74). Grouping similar terms and bearing in 
mind that 

ho = h(a) = 0, has, = W(b) = 0, 


we can write (75) as 


S [(a.ax + apt Pine — 2 Pt _s- (76) 
{=1 





In other words, the quadratic functional (74) can be approximated by a 
quadratic form in n variables /,,..., 4,, with the n x n matrix 














a, b, 0 0 0 0 
by Qo by Ss Bae. 0 0 0 
0 b a 0 0 0 
aes ' (77) 
0 bn-2 Qn-1 bn-1 
0 0 0 0 ba-1 An | 
where 
a, = Q,Ax + Pert Pr G@ = 1,...,”) (78) 
and 
ne = 
Di G@=1,...,.2—- 1). (79) 


A symmetric matrix like (77), all of whose elements vanish except those 
appearing on the principal diagonal and on the two adjoining diagonals, 
is called a Jacobi matrix, and a quadratic form with such a matrix is called 
a Jacobi form. For any Jacobi matrix, there is a recurrence relation between 
the descending principal minors, i.e., between the determinants 


a, b, 0 0 oOo oO 
b, az by 0 0 0 
0 be ag 0 0 0 
dD, = , (80) 
0 0 bj» Qi-1 by-1 
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where / = 1,...,m. In fact, expanding D, with respect to the elements of 
the last row, we obtain the recursion relation 


D, = a,D,-, — 67-1 D,-2, (81) 


which allows us to determine the minors D3,..., D, in terms of the first two 
minors D, and Dz. Moreover, if we set D) = 1, D_, = 0, then (81) is 
valid for all / = 1,..., 2, and uniquely determines D,,..., D,. 

According to a familiar result, sometimes called the Sylvester criterion, 
a quadratic form 


1 


S One EK (Qs = Aix) 


1 
is positive definite if and only if the descending principal minors 


411 Ay2 Arg 
Qi, 12 


Q11, » |@o, @g2 Qgg|, ..., det Il air 








Qo, Goo 
43, Q32 43a 


of the matrix ||q;,|| are all positive.2® Applied to the present problem, 
this criterion states that the Jacobi form (76), with matrix (77), is positive 
definite if and only if all the quantities defined by (81) are positive, where 
i=1,...,nand D) = 1, D_, =0. 

We now use this result to obtain a criterion for the quadratic functional 
(74) to be positive definite. Thus, we examine what happens to the recur- 
rence relation (81) as n> oo. Substituting for the coefficients a; and b, 
from (78) and (79), we can write (81) in the form 


: 2 
D, = (O.dx + Fees us “) Dy fa 


Ax ~ Gx Pi? (i= l,...,7). (82) 
It is obviously impossible to pass directly to the limit nm — oo (i.e., Ax > 0) 
in (82), since then the coefficients of D,;_, and D,.,. become infinite. To 
avoid this difficulty, we make the ‘‘change of variables”’ 27 


P,--:- PZ : 
D= a (Gi =1,...,”), 

Z 
Dy =, = 1; (83) 
D_»~=Z,=90 


7 See e.g., G. E. Shilov, op. cit., Theorem 27, p. 131. 
* Substituting the expressions (78) and (79) into (80), we find by direct calculation 
that D, is of order (Ax)~‘, and hence that Z, is of order Ax. 
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In terms of the variables Z,, the recurrence relation (82) becomes 


Pye? PLias Pg SB) A 
(7. (2. RE ie (Ax) 
_ PR Pie Pia ohy-1 
(Ax? (an 





ie., 
Q.Z(Ax)? + P,-1Z, + PZ, — PiZi41 — Py-1Z;-1 = 0 
or 


1 LZi+ —Z, Zi — Z- . 
OZ, - ~ (RA = PS) =0 (=1,...,”). (84) 


Passing to the limit Ax — 0 in (84), we obtain the differential equation 
d ; _ 
— ZF (PZ') + OZ = 0, (85) 


which is just the Jacobi equation! 

The condition that the quantities D, satisfying the relation (82) be positive 
is equivalent to the condition that the quantities Z, satisfying the difference 
equation (84) be positive, since the factor 


is always positive [because of the condition P(x) > 0]. Thus, we have proved 
that the quadratic form (76) is positive definite if and only if all but the first 
of the n+ 2 quantities Zo, Z,,..., Zn+1 Satisfying the difference equation 
(84) are positive.*® 

If we consider the polygonal line II, with vertices 


(a, Zo); (*1, Z,), aes | (6, Zn+) 
recall that a = Xo, b = x, ), the condition that Z, = 0 and Z, > O for 
i= 1,...,2+ 1 means that ITI, does not intersect the interval [a, b] except 


at the end point a. As Ax->0, the difference equation (84) goes into 

the Jacobi differential equation (85), and the polygonal line ITI, goes into a 

nontrivial solution of (85) which satisfies the initial condition 
ee. Baines in 


m—= 
Azr—0 Ax Az—>0 Ax 


1 


and does not vanish fora < x < 6. In other words, as n—> o, thie Jacobi 
form (76) goes into the quadratic functional (74), and the condition that (76) 


* Note that Z, = 0, Z: = Ax > 0, according to (83). Note also that these two 
equations, together with the nm equations (84), form a system of m + 2 independent 
linear equations in m + 2 unknowns, and that such a system always has a unique 
solution. 
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be positive definite goes into precisely the condition for (74) to be positive 
definite given in Theorem 3 of Sec. 26, i.e., the condition that [a, 6] contain 
No points conjugate to a. The legitimacy of this passage to the limit can 
be made completely rigorous, but we omit the details. 


PROBLEMS 


1, Calculate the second variation of each of the following functionals: 
a) J[y] = ii F(x, y) dx; 
b) J[y] = f F(x, IY, Ws Y™) dx; 
c) J[uj = ne F(x, y, U, Uz, Uy) dx dy. 
2. Show that the second variation of a linear functional is zero. State and 


prove a converse result. 


3. Prove that a quadratic functional is twice differentiable, and find its first 
and second variations. 


4. Calculate the second variation of the functional 
el yl 
where J[y] is a twice differentiable functional. 
Ans, Sev = [(87)? + 877 Je), 


5. Give an example showing that in Theorem 2 of Sec. 24, we cannot replace 
the condition that 82J [A] be strongly positive by the condition that 87/ [A] > 0. 


6. Derive the analog of Legendre’s necessary condition for functionals of the 
form 


Jt} = | f FOG», 4, ues ws) dx dy, 


where u vanishes on the boundary of R. 
Ans. The matrix 
| Fuyur Fuyuy 


lige iB 


UyUy | 


| 








should be nonnegative definite (cf. p. 119). 
7. For which values of a and 6 is the quadratic functional 
[F709 - bP eI dx 


nonnegative for all f(x) such that f(0) = f(a) = 0? Deduce an inequality 
from the answer. 


8. Show that the extremals of any functional of the form 


iN F(x, y’) dx 


have no conjugate points. 
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9. Prove that if a family of extremals drawn from a given point A has an 
envelope £, then the point where a given extremal touches E is a conjugate 
point of A. 


10. Investigate the extremals of the functional 
Jul =| 2adx, yO = 1,1) = 4, 


where 0 < a, 0 < A < 1. Show that two extremals go through every pair 
of points (0, 1) and (a, A). Which of these two extremals corresponds to 
a weak minimum? 


Hint. The line x = Ois an envelope of the family of extremals. 


11. Prove that the extremal y = yix/x, corresponds to a weak minimum of 


both functionals 
pe pee 
0 y 0 y? 


where y(0) = 0, y(x1) = yi, X1 > 0,91 > O. 


12. What is the restriction on a if the functional 
[or 24x, 0) = ya) = 0 


is to satisfy the strengthened Jacobi condition? Use two approaches, one 
based on Jacobi’s equation (42) and the other based on Definition 4 (p. 114) 
of a conjugate point. 


13. Is the strengthened Jacobi condition satisfied by the functional 
IDI = [07 +9 + x7)dx 0) = 0, ya) = 0 
for arbitrary a? 


Ans. Yes. 


14. Let y = y(x, a, 8B) be a general solution of Euler’s equation, depending on 
two parameters « and 8. Prove that if the ratio 


dy/da 
by/ eB 


is the same at two points, the points are conjugate. 


15. Consider the catenary 





x+b 
y= c cosh ( as ): 
where 6 and c¢ are constants. Show that any point on the catenary except 
the vertex (— 6, c) has one and only one conjugate, and show that the tangents 
to any pair of conjugate points intersect on the x-axis. 


6 


FIELDS. 
SUFFICIENT CONDITIONS 
FOR A STRONG EXTREMUM 


In our study of sufficient conditions for a weak extremum, we introduced 
the important concept of a conjugate point. The simplest and most natural 
way to introduce this concept is based on the use of families of neighboring 
extremals (see Sec. 27). Then the conjugate of a point M lying onan extremal 
y is defined as the limit of the points of intersection of y with the neighboring 
extremals drawn from M. 

The utility of studying families of extremals rather than individual extremals 
is particularly apparent when we turn our attention to the problem of finding 
sufficient conditions for a strong extremum. The study of such families of 
extremals is intimately connected with the important concept of a field, 
which we introduce in the next section. Since the concept of a field is 
useful in many problems, we first give a general definition of a field, which is 
not directly related to variational problems. 


31. Consistent Boundary Conditions. General Definition 
of a Field 


Consider a system of second-order differential equations 


Vie =F Vrs 6s Vas Vivo 0 Yn) Gi =1,...,”), (1) 


solved explicitly for the second derivatives. In order to single out a definite 
131 
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solution of this system, we have to specify 2n conditions, e.g., boundary 
conditions of the form 


Vi = Vir, - ~~ Yn) Gi = I,..., 2) (2) 


for two values of x, say x, and x2. Boundary conditions of this kind are 
commonly encountered in variational problems. If we require that the 
boundary conditions (2) hold only at one point, they determine a solution 
of the system (1) which depends on n parameters. 

We now introduce the following definitions: 


DEFINITION 1. The boundary conditions 


Yi = VP», Vn) (i= 1,...,7), (3) 
prescribed for x = x, and the boundary conditions 
Vi = WP, - 5) Yn) G= I,...,7), (4) 


prescribed for x = Xz, are said to be (mutually) consistent if every solution 
of the system (1) satisfying the boundary conditions (3) at x = x, also 
satisfies the boundary conditions (4) at x = x2, and conversely.) 


DEFINITION 2. Suppose the boundary conditions 


Y= VOI.) == 1,...54) (5) 


(where the |; are continuously differentiable functions) are prescribed for 
every x in the interval [a, b], and suppose they are consistent for every 
pair of points x,, X2 in [a,b]. Then the family of mutually consistent 
boundary conditions (5) is called a field (of directions) for the given 
system (1). 


As is clear from (5), boundary conditions prescribed for every value of x 
define a system of first-order differential equations. The requirement that 
the boundary conditions be consistent for different values of x means that 
the solutions of the system (5) must also satisfy the system (1), i-e., that (1) 
is implied by (5). 

Because of the existence and uniqueness theorem for systems of differential 
equations,” one and only one integral curve of the system (5) passes through 


1 Thus, one might say that the boundary conditions at x; can be replaced by the bound- 
ary conditions at x2 which are consistent with those at x;. In a boundary value 
problem, the boundary conditions represent the influence of the external medium. 
But in every concrete problem, we are at liberty to decide what is taken to be the external 
medium and what is taken to be the system under consideration. For example, in 
studying a vibrating string, subject to certain boundary conditions at its end points, 
we can focus our attention on a part of the string, instead of the whole string, regarding 
the rest of the string as part of the external medium and replacing the effect of the 
‘‘discarded”’ part of the string by suitable boundary conditions at the end points of the 
‘“‘retained”’ part of the string. 

2 See e.g., E. A. Coddington, op. cit., Chap. 6. 
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each point (x, y,,...,¥,) of the region R where the functions (x, ¥1,.--, Va) 
are defined. According to what has just been said, each of these curves is 
at the same time a solution of the system (1). Thus, specifying a field (5) 
of the system (1) in some region R defines an n-parameter family of solutions 
of (1), such that one and only one curve from the family passes through each 
point of R. Thecurves of the family will be called trajectories of the field.° 

The following theorem gives conditions which must be satisfied by the 
functions (x, y1,...,¥n), | <is<n, if the system (5) is to be a field 
for the system (1): 


THEOREM. The first-order system 
Vi = VOX, Vi...) (@Sx< bs 1 <iK<n) (6) 
is a field for the second-order system 


Vi = Sil, Vay. +s Vue Vas + +9 Vn) (7) 


if and only if the functions (x, Y1,.-.-;¥n) Satisfy the following system 
of partial differential equations, called the Hamilton-Jacobi system* for 
the original system (7): 

Hw Tm, _ 
ax + 2, Byg Ve = LU Yay Ins Hav sy Yas (8) 
Thus, every solution of the Hamilton-Jacobi system (8) gives a field for 
the original system (7) 


Proof. Differentiating (6) with respect to x, we obtain 
i.e., 


Thus, the system (7) is a consequence of the system (6) if and only if 
(8) holds. 


Example 1. Consider a single linear differential equation 
y" = Plx)y- (9) 


3 A field is usually defined not as a family of boundary conditions which are compatible 
at every two points, but as a set of integral curves of the system (1) which satisfy the 
conditions (5) at every point, i.e., as a general solution of the system (5). However, 
it seems to us that our definition has certain advantages, in particular, when applying 
the concept of a field to variational problems involving multiple integrals. 

* For an explanation of the connection between the system (8) and the Hamilton- 
Jacobi equation defined in Chapter 4, see the remark on p. 143. 
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The corresponding Hamilton-Jacobi system reduces to a single equation 


a bie x y = pix)y, 
i.e., 
as et iw = p(x)y. (10) 


The set of solutions of (10) depends on an arbitrary function, and according 
to the theorem, each of these solutions is a field for equation (9). 
The simplest solutions of (10) are those that are linear in y: 
p(x, y) = a(x) y. (11) 
Substituting (11) into (10), we obtain 
a'(x)y + a%(x)y = p(x). 

Thus, «(x) satisfies the Riccati equation 

a'(x) + «?(x) = p(x). (12) 
Solving (12) and setting 

y’ = afx)y, 

we obtain a field (which is linear in y) for the differential equation (9). 


Example 2. In the same way, we can find the simplest field for a system 
of linear differential equations 
Y" = P(x)Y, (13) 


where Y = (yy,..-,)n) and P(x) = ||py(x)|| is a matrix. The system of 
Hamilton-Jacobi equations corresponding to (13) is 


7] — 6 “ . 
Fe + DF te =D Pale C= dasa (14) 
k=1 k=1 
Let us look for a solution of (14) which is linear in Y, i.e., 
bilx, Viy--+s Yn) =, > Osie(X) Vics (15) 
or in vector notation, 
Y= AY. 


Substituting (15) into (14), we obtain 


> o4e(X) Ye + > 44) b3 eX) Ys = > PulX) Vies 


or in matrix form 


[= AG) Y + A%Xx)Y = P(x), 
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where A = |\a,,||. Thus, if the matrix A(x) satisfies the equation 
d 2 
Ala) + A%x) = PC), 


which it is natural to call a matrix Riccati equation (cf. p. 120), the functions 
(15) define a field for the system (13), and this field is linear in y. 

It is worth noting, although this observation will not be needed later, 
that the concept of a field is intimately related to the solution of boundary 
value problems for systems of second-order differential equations by the 
so-called “‘sweep method.” We illustrate this method by considering the 
very simple case where the system consists of a single linear differential 
equation 


y"(x) = PO) yx) + £(>), (16) 
with the boundary conditions 
y'(a) = coy(a) + do, (17) 
y'(b) = cry(b) + ah. (18) 
We begin by constructing the first-order differential equation 
YX) = a(x) yx) + BO) (19) 


and requiring that all its solutions satisfy the boundary condition (17) and 
the original equation (16). Obviously, to meet the first requirement, we 
must set 


aa) = Co, Bla) = do. (20) 
To meet the second requirement, we differentiate (19), obtaining 
y"(X) = a(x) VX) + ax) y"QX) + B'Q). 
Substituting (19) for y’(x) in the right-hand side, we find that 
y"(x) = [ala + 07x] ye) + BCD + a(x)B(X), 
from which it is clear that (19) implies (16) if 


a(x) + a(x) = p(x), 
Bi(x) + a(x)B(x) = f(x). 


Now let o(x) and B(x) be a solution of the system (21), satisfying the 


initial conditions (20). Once we have found a(x) and A(x), we can write a 
“boundary condition” 


(21) 


Y'(%o) = «(X0) ¥(%0) + B(%o) 


for every point x, in [a, 6]. This process of shifting the boundary condition 
originally prescribed for x = a over to every other point in the interval 
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[a, b] is called the ‘forward sweep.” In particular, setting x = 5, we obtain 
the equation 


y'(6) = a()y(b) + B(), 


which, together with the boundary condition (18), forms a system determining 
y(6) and y'(6). If these values are uniquely determined, our original boundary 
value problem has a unique solution, i.e., the solution of equation (19) which for 
x = b takes the value y(b) just found. This second stage in the solution of 
the boundary value problem is called the “‘backward sweep.’”’ These consider- 
ations apply to the case of a single equation, but a similar method can be 
used to deal with systems of second-order differential equations. 

The use of the sweep method to solve the boundary value problem con- 
sisting of the differential equation (16) and the boundary conditions (17) 
and (18) has decided advantages over the more traditional method. [In the 
latter method, we first find a general solution of equation (16) and then choose 
the values of the arbitrary constants appearing in this solution in such a way 
that the boundary conditions (17) and (18) are satisfied.] These advantages 
are particularly marked in cases where one must resort to some kind of 
approximate numerical method in order to solve the problem.® 

The connection between the sweep method and the concept (introduced 
earlier) of the field of a system of second-order differential equations is now 
entirely clear. In fact, in the simple case just considered, the forward sweep 
is nothing but the construction of a field linear in y for equation (16). More- 
over, (21) is just the system of ordinary differential equations to which the 
Hamilton-Jacobi system reduces in the case where we are looking for a field 
linear in y of a single second-order differential equation.® 

We might have constructed a field starting from the right-hand end point 
of the interval [a, 5}, rather than from the left-hand end point. Thus, our 
boundary value problem actually involves two fields for equation (16), 
one of which is determined by shifting the boundary condition (17) from a 
to 5, and the other by shifting the boundary condition (18) from btoa. The 
solution of the boundary value problem consisting of the differential equation 
(16) and the boundary conditions (17) and (18) is a curve which is a common 
trajectory of these two fields. Thus, in the sweep method, we construct 
one field (the forward sweep) and then choose one of its trajectories which is 
simultaneously a trajectory of a second field (the backward sweep). 


5]. S. Berezin and N. P. Zhidkov, Metogti Boiuncnennia, Tom II (Computational 
Methods, Vol. 11), Gos. Izd. Fiz.-Mat. Lit., Moscow (1959), Chap. 9, Sec. 9. 

® In Example !, we considered the even simpler homogeneous differential equation 
y” = p(x)y, and correspondingly, we looked for a field of the homogeneous form 
y’ = a(x)y. This led to the Riccati equation (12) for the function «(x), identical with 
the first of the equations (21). 
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32. The Field of a Functional 


32.1. Wenow apply the considerations of the preceding section to variational 
problems. The Euler equations 


d ; 
Fy — 7, Fu = 9 G =1,...,a), 
corresponding to the functional 
o 
Rice ene ee (22) 


form a system of n second-order differential equations. In order to single 
out a definite solution of this system, we have to specify 2” supplementary 
conditions, which are usually given in the form of boundary conditions, i.e., 
relations connecting the values of y; and y; at the end points of the interval 
[a, 5) (there are n such relations at each end point). In many cases, of 
course, the boundary conditions are determined by the very functional under 
consideration. For example, consider the variable end point problem for 
the functional 


(7) 
i F(x, Yi, ve > Var Vis oe «Vn aX + g(a, yi, ante 77) + gb, yi, gts > Ya)s 
(23) 
differing from (22) by two functions g‘? and g of the coordinates of the 
end points of the path along which the functional is considered. Calculating 
the variation of the functional (23), we obtain 


[> (m-# Fy) de + > Fgh 


r= 





+ s gSPh(a) + > gi? h(b). 


Setting (24) equal to zero, and assuming that the curve y; = yi(x), 1 <i <n, 
is an extremal, we find that 


n zr=b n 
> Fyh| + > gPh(a) + > g?Ph(b) = 0. (25) 
f=1 zr=a = 
Since A,(a) and A,(5) are arbitrary, (25) implies that 
(Fy, — sp lena = 90 (f= 1s...) (26) 
and 
(Fy, — 8? )\r=5 = (= 1,..., 7). (27) 


If g) = g® = 0, (25) implies 
Fyilz=a = Fyilr=o =0, 
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i.e., the natural boundary conditions for a variable end point problem like 
the one considered in Sec. 6 [cf. Chap. 1, formula (29)].” 

Next, we examine in more detail the boundary conditions corresponding 
to one end point, say x = a. For simplicity, we write g instead of g%, 
and adopt the vector notation 

Y= (Yi,-- +5 Yads Y =O%1---5 Vn) 
etc., in arguments of functions (cf. Sec. 29). As usual, we introduce the 
“momenta” (see footnote 15, p. 86) 
PAX, YY) = Ful yy) C= 1...) (28) 
and then write the boundary conditions (26) in the form 


PAX, Ys Y')ie=0 = By(X,Y\r=a (FG = 1,..-, 0). (29) 
The relations (28) determine y;(a), ..., y,(a) as functions of y,(a),..., y,(a):° 
ya) = 4,022. (= 1,..., 0). (30) 


Boundary conditions that can be derived in this way merit a special name: 


DEFINITION 1. Given a functional 


t) 
[ F(x, y, y') dx, 
with momenta (28), the boundary conditions (30), prescribed for x = a, 
are said to be self-adjoint if there exists a function g(x, y) such that 
pilx, JV» P(y)]lz=0 = By (x, Vl a8 (i =1,..., n). (31) 
THEOREM |. The boundary conditions (30) are self-adjoint if and only 
if they satisfy the conditions 
épilx, ¥, YO)] — Spxlxs ¥, V)I ep, 
on abe SO [eee yale (i,k =1,...,”) (32) 
called the self-adjointness conditions. 





a 


7 It should also be noted that the boundary conditions corresponding to fixed end points 
can be regarded as a limiting case of the boundary conditions (26) and (27), although the 
latter involve the additional functions ge? and g®. For example, in the case of the functional 


o 
[Fes 9) dx — kiya) — AP, 

the boundary condition at the left-hand end point is 

[Fy (x, ¥,”) — 2k(y — A)]lz-a = 0 
or 
Fy (%y,¥) 

2k t-a. 

If we now let k —» 00, we obtain in the limit the boundary condition y(a) = A. Similar 
considerations apply to the case of several functions y,,..., ¥n- 


® The conditions (30) can be thought of as assigning a direction to every point of the 
hyperplane x = a. ([Cf. formula (2).] 


y(a) = At 
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Proof. If the boundary conditions (30) are self-adjoint, then (31) 
holds, and hence 


apilx, y, y)) _ Pa(x, ¥) _ aplx, ¥, VY) 


OV OY, OV: ay 
which is just (32). Conversely, if the boundary conditions (30) are such 
that the functions p,[x, y, b(y)] satisfy (32), then, for x = a, the p, are 


the partial derivatives with respect to y, of some function g(y),® so that 
the boundary conditions (30) are self-adjoint in the sense of Definition 1. 


Remark. It is immediately clear that for n = 1, i.e., in the case of varia- 
tional problems involving a single unknown function, any boundary con- 
dition is self-adjoint, and in fact, the self-adjointness conditions (32) disappear 
forn = 1. 


32.2. In the preceding section, we introduced the concept of a field for a 


system of second-order differential equations. We now define the field of 


a functional: 


DEFINITION 2. Given a functional 


[. Fos». ») de, (33) 
with the system of Euler equations 
F,, ~ 2 Fy, =0 Gi =4,...,n), (34) 
we say that the boundary conditions 
wav) GH 4,....9), (35) 
prescribed for x = x,, and the boundary conditions 
Ww= VQ) C= 1,...,0), (36) 


prescribed for x = xX, are (mutually) consistent with respect to the 
functional (33) if they are consistent with respect to the system (34), i.e., 
if every extremal satisfying the boundary conditions (35) at x = x, 
also satisfies the boundary conditions (36) at x = x2, and conversely. 


DEFINITION 3. The family of boundary conditions 


YW=4(4y) GL...) (37) 


° See e.g., D. V. Widder, op. cit., Theorem 11, p. 251, and T. M. Apostol, Advanced 


Calculus, Addison-Wesley Publishing Co., Inc., Reading, Mass. (1957), Theorem 
10-48, p. 296. (We tacitly assume the required regularity of the functions p, and of 


their domain of definition.) 
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prescribed for every x in the interval [a, b), is said to be a field of the 
functional (33) if 


1. The conditions (37) are self-adjoint for every x in [a, b]; 


2. The conditions (37) are consistent for every pair of points X,, X2 in 
[a, 5}. 


In other words, by a field of the functional (33) is meant a field for the 
corresponding system of Euler equations (34) which satisfies the self- 
adjointness conditions at every point x. The equations (37) represent a 
system of first-order differential equations. Its general solution (the family 
of trajectories of the field) is an n-parameter family of extremals such that 
one and only one extremal passes through each point (x, y,,..., ¥,) of the 
region where the field is defined.'° 

We now give an effective criterion for a given family of boundary con- 
ditions to be the field of a functional: 


THEOREM 2.1! 4 necessary and sufficient condition for the family of 
boundary conditions (37) to be a field of the functional (33) is that the 
self-adjointness conditions 


épilx, J; v(x, y)] = op,t[x, ys p(x, y)] (38) 
OY, Oy, 
and the consistency conditions 
epilx, y> yx, y)) ee oH [x, y Y(x, y)) (39) 
Ox oy, 


be satisfied at every point x in [a, b], where 
PAX, VY, ¥’) = Fyi(x, y, ¥'), (40) 


and H is the Hamiltonian corresponding to the functional (33): 
H(x, yy) = —FOG WY) + D> PGW. (41) 
f=1 


Proof. We have already shown in Theorem | that the conditions (38) 
are necessary and sufficient for the boundary conditions 


Yi = ix, y) G= 1,...,7) (42) 


10In the calculus of variations, by a field (of extremals) of a functional is usually 
meant an n-parameter family of extremals satisfying certain conditions, rather than a 
family of boundary conditions of the type just described. However, as already remarked 
(see footnote 3, p. 133), it seems to us that our somewhat different approach to the con- 
cept of a field has certain advantages. 

1 This theorem is the analog of the theorem of Sec. 31, and the system of partial 
differential equations (39) is the analog of the Hamilton-Jacobi system (see p. 133). 
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to be self-adjoint at every point xin [a,b]. Therefore, it only remains to 
show that if (38) holds at every point x in [a, 6], then the conditions (39) 
are necessary and sufficient for the boundary conditions (42) to be con- 
sistent fora < x < 6. To prove this, we set 


Yi = yalx, y), y = vx, y) 


in (40) and (41), and substitute the right-hand sides of the resulting 
equations into (39). Performing the indicated differentiations and 
dropping arguments (to keep the notation concise), we obtain 











: oy, 
k=. 
4 
asd OF y, 5 Fy Pet 
=1 oy k=1 = oy, 
Using the self-adjointness conditions 
OF, _ OF y; 
ay OV, 
we can write (43) in the form 
. OVE _ Fy, 
= Z es tg, dimes peered | 44 
Since 
OF, “ ! 
‘_ F, F , 
Oy, vive + 2 vii B 


(44) becomes 
n n ral n rol 
Fy, = Fy. + > Fyiye + > Faye + bY Fe 4): (45) 
k=1 k=1 j 


Along the trajectories of the field, we have 


so that 





dy, — CY, S Obi, 
dx? xt 2 Y; 


Therefore, (45) reduces to 


; = 0, (46) 
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where | < i<¢an. This means that the trajectories of the field of 
directions (42) are extremals, i.e., (42) is a field of the functional 


[. Fos x dx, (47) 


and hence the conditions (39) are sufficient. Since the calculations 
leading from (39) to (46) are reversible, the conditions (39) are also 
necessary, and the theorem is proved. 


THEOREM 3. The expression 


Op(x,¥, Y') _ Opx(x, y, ¥') 
CPAs YY) OPA YS FD 48 
27 éy, ) 
has a constant value along each extremal. 


Proof. Using (46), we find that 


d (2: A) a OF, — OFy, _ 0 


dx\dy, dy) oy, oy 








CorROLiary. Suppose the boundary conditions 
W=¥yY @<x<bl<i<n (49) 


are consistent, i.e., suppose the solutions of the system (49) are extremals 
of the functional (41). Then, to prove that the conditions (49) define a 
field of the functional (47), it is only necessary to verify that they are self- 
adjoint at a single (arbitrary) point in [a, b}. 


According to Definition 1, the boundary conditions (49) are self-adjoint 
if there exists a function g(x, y) such that 


Pilx, y, Y(x, y)] = gy,(x, y) (i= Dy dicey n) (50) 


fora <x <b. We now ask the following question: What condition has 
to be imposed on the function g(x, y) in order for the boundary conditions 
(49), defined by the relations (50), to be not only self-adjoint, but also 
consistent, at every point of [a, 6], i.e., for the boundary conditions (49) 
to be a field of the functional (47)? The answer is given by 


THEOREM 4. The boundary conditions (49) defined by the relations (50) 
ere consistent if and only if the function g(x, y) satisfies the Hamilton- 
Jacobi equation’? 


ag og Og \ _ 
FE 4 A(x. Yay Tas Gr FE] = 0. (51) 


12 Cf, equation (72), p. 90. 
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Proof. It follows from (50) that the Hamilton-Jacobi equation (51) 
can be written in the form 


a 
= = — (xX, yay. ++) Yao Pas ++ +s Pr) (52) 


where p, = p,[x, y, ((x, y)]. Differentiating (52) with respect to y, 
we obtain 


0g = _ OH[x, Vi, -- Yas vi(x, y), ++, YalX YI 
Ox OY; oy 
i.e., 
op, = __OH[X, Vis. + +> Yrs al, Y), ++» Pal YD] 
ox oy, 


which is just the set of consistency conditions (39). 


Remark. The connection between the Hamilton-Jacobi system intro- 
duced in Sec. 31 and the Hamilton-Jacobi equation introduced in Sec. 23 is 
now apparent. As we saw in Sec. 3], in the case of an arbitrary system of 
n second-order differential equations, a field is a system of 7 first-order 
differential equations of the form (49), where the functions y,(x, y) satisfy 
the Hamilton-Jacobi system (8). When we deal with the field of a functional, 
the system (8) turns into the consistency conditions (39), and in this case, 
we impose the additional requirement that the boundary conditions defining 
the field be self-adjoint at every point. This means that the field of a 
functional is not really determined by x» functions (x, y), but rather by 
a single function g(x, y) from which the functions J,(x, y) are derived by using 
the relations (50). In other words, the function g(x, y) is a kind of potential 
for the field of a functional. Since the field of a functional is determined by 
a single function, instead of by functions, it is entirely natural that the set 
of n consistency conditions for such a field should reduce to a single equation, 
i.e., that the Hamilton-Jacobi system should be replaced by the Hamilton- 
Jacobi equation. 


32.3. Once more, we consider a functional 


[, Fos yy) dx (53) 


whose extremals are curves in the (# + 1)-dimensional space of points 
(x,y) = (x, ¥i,---; Yn)» Let R be a simply connected region in this space, 
and let c = (co, ¢i,..., Cn) be a point lying outside R. 
DEFINITION 4. Let (x, y) be an arbitrary point of R, and suppose that 
one and only one extremal of the functional (53) leaves c and passes 
through (x, y), thereby defining a direction 


y= v(x, y) (Gi= 1,...,”) (54) 
at every point of R. Then the field of directions (54) is called a central field. 
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THEOREM 5. Every central field (54) is a field of the functional (53), 
i.e., satisfies the consistency and self-adjointness conditions. 


Proof. Consider the function 


a(x») =f" FO») ds (55) 


where the integral is taken along the extremal of (53) joining the point 
c to the point (x, y). We define a field of directions in R by setting 
FyQG YY) = PY Y) = Bul Y) = 1,....0). 56) 


The theorem will be proved if it can be shown that this field coincides with 
the original field (54), since then the original field will satisfy the consis- 
tency conditions [since its trajectories are extremals] and also the self- 
adjointness conditions [this follows from Theorem | applied to the field 
defined by (56)]. But (55) is just the function S(x, y,,..., Yn) of Sec. 23, 
and hence 


By,(x, y) rn Dix, y> z), 


where z denotes the slope of the extremal joining c to (x, y), evaluated 
at (x, y).'4. This shows that the field of directions (56) actually coincides 
with the original field (54). 


DEFINITION 5. Given an extremal y of the functional (53), suppose there 
exists a simply connected (open) region R containing y such that 


1. A field of the functional (53) covers R, i.e., is defined at every point 
of R; 
2. One of the trajectories of the field is y. 


Then we say that y can be imbedded ina field [of the functional (53)]. 
THEOREM 6. Let y be an extremal of the functional (53), with equation 
y=WX) (Ax d), 
in vector form. Moreover, suppose that 
det || Fy-vil 


is nonvanishing in [a, b], and that no points conjugate to (a, y(a)) lie on y. 
Then y can be imbedded in a field. 


Proof. By hypothesis, the following two conditions are satisfied for 
sufficiently small e > 0: 


1. The extremal y can be extended onto the whole interval [a — «, 5]; 


2. The interval [a — «, 6] contains no points conjugate to a (cf. foot- 
note 20, p. 121). 


13 See the second of the formulas (70) and footnote 18, p. 90. 
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Now consider the family of extremals leaving the point (a — e, y(a — ¢)). 
Since there are no points conjugate to a — e in the interval [a — e, 5], it 
follows that for a < x < 5 no two extremals in this family which are 
sufficiently close to the original extremal y can intersect. Thus, in some 
region R containing y, the extremals sufficiently close to y define a central 
field in which y is imbedded. The proof is now completed by using 
Theorem 5. 


33. Hilbert’s Invariant Integral 


As before, let R be a simply connected region in the (n + 1)-dimensional 
space of points (x, y) = (x, yi.-..-, Yn), and let 


i= yilx, y) (i = l, sey n) (57) 


define a field of the functional 


[. F(x, y, y’) dx (58) 


in R. It was proved in the preceding section (see Theorem 2) that the field 
of directions (57) is a field of the functional (58) if and only if the functions 
vi(x, y) satisfy the self-adjointness conditions 


CPx, y> vey, y)) bes cpxlx, y U(x, y)) (59) 
CVs, oy; 
and the consistency conditions 


CH Ix, ¥, AX Y)) _ _ ei. POG YD. 
Cy, x 


(60) 
Taken together, the conditions (59) and (60) imply that the quantity 
—H[x,y, Wx yl dx + > pbs y YO YI dy, 
i=1 


is the exact differential of some function (see footnote 9, p. 139) 


g(x, y) = a(x, V1, ey Vn) 


As is familiar from elementary analysis,'* this function, which is determined 
to within an additive constant, can be written as a line integral 


g(x,y) = [(-Has + > P dy,), (61) 


evaluated along the curve I" going from some fixed point My = (Xo, y(X9)) to 
the variable point M = (x, y). Since the integrand of (61) is an exact 


14 See e.g., D. V. Widder, op. cit., Theorem 12, p. 251. 
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differential, the choice of the curve [' does not matter; in fact, the value of the 
integral depends only on the points My, M,, and not on the curve I. The 
right-hand side of (61) is known as Hilbert’s invariant integral. 

Using the equations (57) defining the field, and explicitly introducing 
the integrand F of the functional! (58), we can write the integral in (61) as 


J, ({F ls 2 905 901 — 3 ee DF» en )} de 


: (62) 
+ > Fils » 4s 231 dn): 


This expression is Hilbert’s invariant integral, in the form corresponding 
to the field defined by the functions (x, y). If the curve I’ along which the 
integral (62) is evaluated is one of the trajectories of the field, then 


dy, = yi(x, y) dx 


along I’, and hence (62) reduces to 
[ FG» ») ax 


evaluated along this trajectory. 


Remark. If y is an extremal which is a trajectory of the field, Hilbert’s 
invariant integral can be used to write the value of the functional for this 
extremal as an integral evaluated along any curve joining the end points of y. 
This important fact will be used in the next section. 


34. The Weierstrass E-Function. Sufficient Conditions for a 
Strong Extremum 


DEFINITION. By the Weierstrass E-function of the functional !* 


T= [ Fey» ds WO=4, WH=B 6) 


we mean the following function of 3n + | variables: 


E(x, ¥, 2, ¥) = F(x. 940) — F942) — > (wr ~ FO. 2) 64) 


In other words, E(x, y, z, w) is the difference between the value of the 


18 Here y(a) = A means y,(a) = Ai,..., ya(a) = An, and similarly for »(b) = B, 
i.e., we are dealing with the fixed end point problem. 


SEC. 34 SUFFICIENT CONDITIONS FOR A STRONG EXTREMUM- 147 


function F (regarded as a function of its last n arguments) at the point w and 
the first two terms of its Taylor’s series expansion about the point z. Thus, 
E(x, y, z, w) can also be written as the remainder of a Taylor’s series: 


E(x, yz.) =4 S$ (H — 2m — 2 F viilss z+ Ow — 2] 


1 
(0<8< 1). 


NI— 


1 


For n = 1, the Weierstrass E-function has a simple geometric interpretation, 
since if we regard F(x, y, z) as a function of z, 


F(x, J; w) = F(x, y, z) aa (w = z)F,(x, y> Zz) 


is just the vertical distance from the curve I’ representing F(x, y, z) to the 
tangent to ' drawn through a fixed point of I’. 

Our goal in this section is to derive sufficient conditions for the functional 
(63) to have a strong extremum. It will be recalled from Secs. 28 and 29 
that the following set of conditions is sufficient for the functional (63) to have 
a weak minimum?® for the admissible curve y: 


Condition 1. The curve y is an extremal; 








Condition 2. The matrix || F,;|| is positive definite along y; 


Condition 3. The interval [a, b] contains no points conjugate to a. 


Every strong extremum is simultaneously a weak extremum, but the 
converse is in general false (see p. 13). Therefore, in looking for sufficient 
conditions for a strong extremum, it is natural to assume from the outset 
that the three conditions just listed are satisfied. We then try to supplement 
them in such a way as to obtain a set of conditions guaranteeing a strong 
extremum as well as a weak extremum. To find such supplementary con- 
ditions, we first recall that Conditions 2 and 3 imply that the given extremal y 
can be imbedded in a field 


y = dix, y) (i =1,.. -,f) (65) 


of the functional (63) [see Theorem 6 of Sec. 32].17 Let y have the equations 


yi = Yi(x) (i =1,...,n), 


and let y* be an arbitrary curve with the same end points as y, lying in the 
(n + 1)-dimensional region R containing y and covered by the field (see 


16 To be explicit, we consider only conditions for a minimum. To obtain conditions 
for a maximum, we need only reverse the directions of all inequalities. 

17 The only part of Condition 2 that is used here is the fact that det ||Fyj.;| is non- 
vanishing (in fact, positive) in [a, 5]. 
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Definition 5 of Sec. 32). Then, according to equation (62) and the remark 
at the end of Sec. 33, we have 


[ Fenny) = [ (Fen) — SuFica x war + > Fils yd by) 
(6) 


where for simplicity we omit the arguments of the functions / andv,. The 
right-hand side of (66) is just Hilbert’s invariant integral, in the form corre- 
sponding to the field (65). As usual, we are interested in the increment 


AJ=[ Foy yx — [ Fey. y") dx. 
y* Y 
Using (66), we find that 
AJ=| Foy y)dx 
ve 
— J, ({Feno- > wren phar + > Fale» 9 dn) 
i=1 f=1 
= [ : (Fu. YY) — FY — > OF — WFC Y, ») dx, 
i=1 
or in terms of the Weierstrass E-function.*® 


As = | Els, y, ¥ 3") de. (67) 


We are now in a position to state sufficient conditions for a strong 
extremum. 


THEOREM |. Let y be an extremal, and let 


¥=¥O,y)  @=1,...,0) (68) 
be a field of the functional 


b 
Jl=[ Foxy dx, a) = 4, (6) = B. (69) 
Suppose that at every point (x, y) = (X, Vi,..-, Yn) of some (open) region 
containing y and covered by the field (68),'° the condition 
E(x, y,, w) 2 0 (70) 
is satisfied for every finite vector w = (,,...,,). Then J[y] has a 


Strong minimum for the extremal y. 
18 More explicitly, 
bo 
Ad = [” Etx, y*, 0, 9") dx, 
sa 


where y, = y*(x) are the equations of the curve y*. 
18 By hypothesis, such a region R exists. 
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Proof. To say that the functional J[y] has a strong minimum for the 
extremal y means that AJ is nonnegative for any admissible curve y* 
which is sufficiently close to y in the norm of the space @(a, 5). But the 
condition (70) guarantees that the increment AJ, given by (67), is non- 
negative for allsuchcurves. Notethat we do not impose any restrictions 
at all on the slope of the curve y*, i.e., y* need not be close to y in the 
norm of the space (a, b). In fact, y* need not even belong to @,(a, b).?° 


Remark 1. As already noted, the hypothesis that the extremal y can be 
imbedded in a field can be replaced by Conditions 2 and 3. 


Remark 2. Since the Weierstrass E-function can be written in the form 
1 n 
E94) = 5 > Or — We — WFrin boy, + Ow — WI 
k=1 
(0<0< 1) 


(see p. 147), we can replace (70) by the condition that at every point of some 
region R containing y, the matrix ||F,-,.(x, y, z)|| be nonnegative definite 
for every finite z. 

We conclude this section by indicating the following necessary condition 
for a strong extremum: 


i, 


THEOREM 2 ( Weierstrass’ necessary condition). If the functional 


b 
IDI=[Feyyd Wa = 4, 0) = 8 
has a strong minimum for the extremal y, then 
E(x, y, y’', w) 2 0 (71) 
along y for every finite w. 


The idea of the proof is the following: If (71) is not satisfied, there exists 
a point € in [a, 6] and a vector g such that 


ETE, v(S), »'(6),4] < 9, (72) 


where y = y(x) is the equation of the extremal y. It can then be shown that 
a suitable modification of y leads to an admissible curve y* close to y in 
the norm of the space @(a, 6) such that 


AJ = [ Feu yy) dx — ik F(x, yy’) dx < 0, (73) 


which contradicts the hypothesis the /[y] has a strong minimum for y. 
However, the construction of y* must be carried out carefully, since all we 
know is that (72) holds for a suitable g (see Probs. 9 and 10). 


20 In problems involving strong extrema of the functional (69), we allow broken 
extremals, i.e., the admissible curves need only be piecewise smooth (and satisfy the 
boundary conditions). 
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PROBLEMS 


1. Find the curve joining the points (—1, —1) and (1, 1) which minimizes 
the functional 


1 
J{y) = ie (x?y’2 + 12y?) dx. 
What is the nature of the minimum? 
1 
Hint. AJ =Jly +h) - Jb) = ie (xh? + 12h) dx > 0. 


Ans. J{y] has a strong minimum for y = x°. 


2. Find the curve joining the points (1, 3) and (2, 5) which minimizes the func- 
tional 


2 
J{y) = iB yd + x*y’) dx. 
What is the nature of the minimum? 
Hint. Again calculate AJ. 


3. Prove that the segment of the x-axis joining x = 0 to x = x corresponds to 
a weak minimum but not a strong minimum of the functional 


Tt 
Jy) = J" vd — y2)dx, (0) = 0, »(m) = 0. 
Hint. Calculate J[y] for 
) eee 
= — sin ax. 
ane n 
4. Prove that the extrema of the functional 
b ——— 
J n(x, y)V1 + y? dx 
are always strong minima if n(x, y) 2 0 for all x and y. 
5. Investigate the extrema of the following functionals: 
2 
a) Jbl= [vat ey)dx, A=) =1, 9Q)= 15 


b) Jiy = J" Gy? - y? + By) dx, 0) = - 1, (e/A) = 0; 
o) Jiy] = [' Gty? + 129") dx, 1) = 1, 2) = 8; 


1 
d) Jiy) = [Oo + y? + 2ye%) de, (0) = 4, WI) = He? 
Ans. b) Astrong maximum for y = sin 2x — 1; d) A strong minimum for 
y = te”, 
6. Prove that y = bx/a is a weak minimum but not a strong minimum of the 
functional 
Jil = |»? dx, 


where y(0) = 0, x(a) = b,a > 0,b > 0. 
Hint, Examine the corresponding Weierstrass E-function. 


PROBLEMS SUFFICIENT CONDITIONS FOR A STRONG EXTREMUM  1|5| 


7. Show that the extremals which give weak minima in Chap. 5, Prob. 10 
do not give strong minima. 


8. Show that the extremal y = 0 of the functional 


pe 
Jly] = if (ay? — 4byy’® + 2bxy'*) dx, 


where 
yO) =0, y1)=0, a>0, b>, 


satisfies both the strengthened Legendre condition and Weierstrass’ necessary 
condition. Also verify that y = 0 can be imbedded in a field of the func- 
tional J[y]. Does y = 0 correspond to a strong minimum of J[y]? 

Hint. Choose 


Ex for O<x<h, 
yY = Yo(x) = 
k iad for h<x<l 
1 = h = = . 
Then, given any k > O however small, there isan fA > 0 such that J[yo] < 0. 


Ans. No. 


9. Complete the proof of Weierstrass’ necessary condition, begun on p. 149. 

Hint. By continuity of the E-function, we can always arrange for the point 
— to be an interior point of [a, 6). Choose Ah > O such that & — A > a, and 
construct the function 


yx) t+(x-—a)Q for a<x<& 
y= ylx) = (x — 8a + WE) for E-hAex<& 
yx) for E<x<b 


where » = y(x) is the equation of the extremal y, and Q is the vector deter- 
mined by the condition 

WE -— A) + (E-—a—h)Q = —Gqh + y(8). 
Then let A(h) = J[y,] — J[y]. Prove that A’(0) = E[E, (&), y’(E), gq] < 0, 
which, together with A(O) = 0, implies that J[y,] — J[y] < 0 for small 
enough A. 


10. Give another proof of Weierstrass’ necessary condition, based on the 
direct use of Hilbert’s invariant integral. 


Hint. Let M, be the point (&, y(&)). From a point Mp on y sufficiently 
close to M, construct a central field of the functional. Let R be the region 
covered by this field, and let D(/) be the value of Hilbert’s invariant integral 
evaluated along any curve in R joining Mo to the variable point M in R. 
Draw two surfaces o, and oc, of the one-parameter family ®(M) = const, 
the first intersecting y in a point M2 lying between My and M,, the second 
intersecting y in the point M,. Moreover, from M, draw the straight line 
with direction qg, and let this line intersect o2 in a point M3. Finally, let y* 
be obtained from y by replacing the part of y from Moy to M, by the curve 
M.M3M,, where MoMsz is the extremal from My, to Mz and M3M, is the 
Straight line segment from Mz, to M,. Again using Hilbert’s invariant 
integral, prove that y* satisfies the inequality (72). 
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VARIATIONAL PROBLEMS 
INVOLVING 
MULTIPLE INTEGRALS 





In this chapter, we discuss a variety of topics pertaining to functionals 
which depend on functions of two or more variables. Such functionals 
arise, for example, in mechanical problems involving systems with infinitely 
many degrees of freedom (strings, membranes, etc.). In our treatment of 
systems consisting of a finite number of particles (see Chapter 4), we derived 
the principle of least action and a general method for obtaining conservation 
laws (Noether’s theorem). These methods will now be applied to systems 
with infinitely many degrees of freedom. 


35. Variation of a Functional Defined on a Fixed Region 


Consider the functional 


TU) = foe fay oy Kas My Mage oy Mag) Ba 2+ Ben (1) 
depending on n independent variables x,,...,x,, an unknown function u 
of these variables, and the partial derivatives u,,,...,u,, of u. (As usual, 


it is assumed that the integrand F has continuous first and second derivatives 
with respect to all its arguments.) We now calculate the variation of (1), 
assuming that the region R stays fixed, while the function u(x4,..., X,) 
goes into 


u*(Xq,...,Xn) = U(X... Xn) + EVO, Xn) toes (2) 
152 
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where the dots denote terms of order higher than | relative toe. By the 
variation 8J of the functional (1), corresponding to the transformation (2), 
we mean the principal linear part (in e) of the difference 

J(u*) — J[u). 


For simplicity, we write u(x), (x) instead of u(x,,..., Xn), V0%1,..-, Xa), 
dx instead of dx, --- dx,, etc. Then, using Taylor’s theorem, we find that 


J(u*] — J[u] = I. {F Lx, u(x) + eb(x), ur, (x) + es, (x), .- + Uz, (x) + edz, (x) 
— F[x, u(x), uz, (2X), .--, uz,(x)]} dx 


= e| (F, + 5 Fun) dx t-+:, 


where the dots again denote terms of order higher than | relative toe. It 
follows that 


sme (F. # > Featha) dx G3) 


is the variation of the functional (1). 

Next, we try to represent the variation of the functional (1) as an integral 
of an expression of the form 

G(x)Y(x) + div (++), 
i.e., we try to transform the expression (3) in such a way that the derivatives 
4, only appear in a combination of terms which can be written as a diver- 
gence. To achieve this, we replace 
Fy, 1,0) 

by 


sie 





51H - me 


in (3), obtaining 
ng +! Fes 1B 
aya ef (F, - > ix F.,,)¥Cs) dx+el > 2 1Fe@) dx. 


This expression for the variation 3J/ has the important feature that its second 
term is the integral of a divergence, and hence can be reduced to an integral 
over the boundary I’ of the region R. In fact, let do be the area of a variable 
element of I, regarded as an (# — 1)-dimensional surface. Then the 
n-dimensional version of Green’s theorem states that 


I, de [Fu @)] dx = | YONG, v) do, (5) 


where 
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is the n-dimensional vector whose components are the derivatives F,,,, 


v = (y,...,%,) is the unit outward normal to I, and (G, v) denotes the 
scalar product of Gand v. Using (5), we can write (4) in the form 


SJ =e fe (F, = >: “ Fi...) 4) dx+e ia U(x\(G, v) do, (6) 


where the integral over R no longer involves the derivatives of (x). 

In order for the functional (1) to have an extremum, we must require 
that 8J = 0 forall admissible (x), in particular, that 87 = Ofor all admissible 
(x) which vanish on the boundary I’. For such functions, (6) reduces to 


m9 
ay 3 (FA = > x F.,.) 42) cP 


and then, because of the arbitrariness of (x) inside R, 57 = 0 implies that 


R->s uz, = 0 (7) 


for all xe R. This is the Euler equation of the functional (1), and is the 
n-dimensional generalization of formula (24) of Sec. 5.! 


Remark. In deriving (7), we assumed that the region of integration R 
appearing in the functional (1) is fixed. Generalization of (7) to the case 
where the region of integration is variable will be made in Sec. 36. 


36. Variational Derivation of the Equations of Motion of 
Continuous Mechanical Systems 


As we saw in Sec. 21, the equations of motion of a mechanical system 
consisting of n particles can be derived from the principle of least action, 
which states that the actual trajectory of the system in phase space mini- 
mizes the action functional 


[ : (T — U) dt, (8) 


where T is the kinetic energy and U the potential energy of the system of 
particles. We now use this principle, together with our basic formula for 
the first variation, to derive the equations of motion and the appropriate 
boundary conditions for some simple mechanical systems with infinitely 
many degrees of freedom, namely, the vibrating string, membrane and plate. 


1 As we shall see in the next section, boundary conditions for the equation (7) can be 
obtained by removing the restriction that y(x) = 0 on IT, and then setting 5J/ = 0 after 
substitution of (7) into (4) or (6). 
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36.1. The vibrating string. Consider the transverse motion of a string 
(i.c., a homogeneous flexible cord) of length 7 and linear mass density p. 
Suppose the ends of the string (at x = 0 and x = /) are fastened elastically, 
which means that if either end is displaced from its equilibrium position, 
a restoring force proportional to the displacement appears. This can be 
achieved, for example, by fastening the ends of the string to two rings which 
are constrained to move along two parallel rods, 
while the rings themselves are held in their initial 
positions by two ideal springs,” as shown in Fig. 8. 
Let the equilibrium position of the string lie 
along the x-axis, and let u(x, t) denote the dis- 
placement of the string at the point x and time 
t from its equilibrium position. Then, at time /, 
the kinetic energy of the element of string 
which initially lies between xp and x, + Ax is 
clearly 


*< 
HT] 
(e) 
»* 
I 
~ 


4 pup(xo, t) Ax. (9) Ficure 8 


Integrating (9) from 0 to /, we find that the kinetic energy of the whole string 
at time f equals 


1 t 
T= 50 [ u2(x, t) dx. (10) 


To find the potential energy of the string, we use the following argument: 
The potential energy of the string in the position described by the function 
u(x,t), where ¢ is fixed, is just the work required to move the string from 
its equilibrium position u = 0 into the given position u(x,t). Let t denote 
the tension in the spring, and consider the element of string indicated by AB 
in Figure 9, which initially occupies the position DE along the x-axis, i.e., 
the interval [x 9, x» + Ax].? Tocalculate the amount of work needed to move 
DE to AB, we first move DE to the position AC. This requires no work at 
all, since the force (the tension in the string) is perpendicular to the dis- 
placement.* Next, we stretch the string from the position AC to the position 
AC’, where the length of AC’ equals the length of AB. This obviously 
requires an amount of work equal to t8, where® isthe length of CC’. Finally, 
we rotate AC’ about the point A into the final position AB. Like the first 
step, this requires no work at all, since at each stage of the rotation the 
force is perpendicular to the displacement. Thus, the total amount of work 


2 The springs are ideal in the sense that they have zero length when not stretched. 

3 Since we only consider the case of small vibrations, the string can be assumed to have 
constant length and constant tension. In the present approximation, we can also assume 
that AB is a straight line segment. 

4 It should be emphasized that since the string is assumed to be absolutely flexible, 
all the work is expended in stretching the string, and none in bending it. 
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required to move DE to AB is just the product of + and the increase in 
length of the element of string, i.e., the quantity 


a re 2 
2V (Ax)? + (Aw? — tAx = 3(=) Reef orn 5 UA %o, Ax +++, 


Ax 
(11) 


where the dots indicate terms of order higher than those written (Au/Ax « 1 
for all ¢, since the vibrations are small). 





Xo + Ax 
Ficur_e 9 


Integrating (11) from 0 to 4, we find that the potential energy of the whole 
string is 


t 
ee [ u2(x, t) dx, (12) 


except for the work expended in displacing the elastically fastened ends of 
the string from their equilibrium positions. This work equals 


— 


Us = 5 xu%(0, 1) + 5 aul, 1, (ts) 


where x, and x, are positive constants (the elastic moduli of the springs). 
[In fact, the force /, acting on the end point P, (see Figure 8) is proportional 
to the displacement & of P, from its equilibrium position x = 0, u = 0, ie., 


\fi| = x,8, (14) 
where x, > 0 is a constant; integration of (14) shows that the work required 
to move P, from (0, 0) to (0, u(0, ¢)), its position at time f, is given by 


pu(O, t) 1 
| 8 dé = 5x00, 0, 
0 2 


and similarly for the otherend point Pp.}_ Then, adding (12) and (13), we find 
that the total potential energy of the string in the position described by 
the function u(x, fr) is 


ol 
U=U, + U2, = se | u2(x, t) dx + cur: t) + Sauer tr). (15) 
2 Jo 2 2 
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Finally, using (10) and (15), we write the action (8) for the vibrating string, 
obtaining the functional 


Tha] = 3° f leuk, ) — wu, 1) dx at 
| 2 to Jo PurLX, TUX, x 
] 4g 1 aes 
2 5% |, u2(0, t) dt — 5% | u2(I, t) dt. 
According to the principle of least action, 8/ must vanish for the function 
u(x,t) which describes the actual motion of the string. Thus, we now 
calculate the variation 35/ of the functional (16). Suppose we go from the 
function u(x, f) to the “‘varied”’ function 
u*(x, t) = u(x, t) + eb(x, ft) + --- 
Then, using formula (4) and the fact that the variation of a sum equals the 
sums of the variations of the separate terms, we find that 


(16) 


SJ = e{{ : if [—puu(x, £) + ripe(x, OW, €) dx dt 
ae f u(0, t) YO, t) dt — x, I : u(l, tyb(2, t) ar 
# ef. I, pa [Sea hoe \hexd 
+e i [, s [ou(x, t)Y(x, t)] dx dt. 
If we assume that the admissible functions (x, 1) are such that 


v(x, fo) = 0, v(x, 4) =0 (0 <x< !), 


i.e., that u(x, ¢) is not varied at the initial and final times, then the last term 
in (17) vanishes and the next to the last term reduces to 


é f * Teu,(0, t)4(0, 1) — tus(l, OUI, 1] dt. 


It follows that the variation (17) can be written in the form 


SJ = ef J c | [—puy + tupe(x, Q]U(x, t) dx dt 


(17) 


-f * teu(0, t) — zu,(0, t)]4(0, 0) at (18) 
— [° bau ) + all, OMG, 1) at} 


According to the principle of least action, the expression (18) must vanish 
for the function u(x, ¢) corresponding to the actual motion of the string. 
Suppose first that {(x, tf) vanishes at the end of the string,® i.e., that 


(0,1) = 0, Yt) =0 (fo < f < 4). (19) 





5 If 3/ vanishes for all admissible Y(x, 1), it certainly vanishes for all admissible y(x, ¢) 
satisfying the extra condition (19). 
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Then (18) reduces to just 
ty fl 
SJ =e i} i, [—puy(x, 1) + tup2(x, t)] Ux, t) dx dt. (20) 


Setting (20) equal to zero, and using the arbitrariness of the interval [to, f;] 
and of the function (x, 1) for 0 < x < 1, tp < t < t, (cf. the lemma of 
Sec. 5), we find that 


ug(2, 1) = auteg(X, £) ( = ;} (21) 


for 0 <x </and all «. This result, called the equation of the vibrating 
string, is the Euler equation of the functional 


5f i [ur(x, t) — tui(x, t)] dx dt. 


Next, we remove the restriction (19). Since u(x, t) must satisfy (21), the 
first term in (18) vanishes, and we have 


ay = —e([ = te,u(O, t) — <u,(0, YO, #) at 
+ [ beau(l 0) + sul, DG, 0 dt} (22) 


This expression must also vanish for the function u(x, f) corresponding to the 
actual motion of the string. Since [to, t,] is arbitrary and (0, 1), Y(/, t) are 
arbitrary admissible functions, equating (22) to zero leads to the relations 


%,u(0, t) — tu,(0, t) = 0 (23) 
and 
xQu(l, t) + tu,(l, t) = 0 (24) 


for all t. Thus, finally, the function u(x, ft) which describes the oscillations 
of the string must satisfy (21) and the boundary conditions 


au(0, t) + u,(0,t) = 0 (« 2 -*1) (25) 
and 


Bull, t) ate ull, t) =0 ( — 2), (26) 


which connect the displacement from equilibrium and the direction of the 
tangent at each end of the string. 

Next, suppose the ends of the string are free, which means that the springs 
shown in Fig. 8 are absent and the rings fastening the string to the lines 
x = 0, x = 7 can move up and down freely. Then x; = x2 = 0, and the 
boundary conditions (23), (24) become 


u,(0, t) = 0, u{i, t) = 0. 
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Thus, at a free end point, the tangent to the string always preserves the same 
slope (zero) as it had in the equilibrium position. 

The case where the ends of the string are fixed, corresponding to the 
boundary conditions 


u(0, t) = 0, u(/, t) = 0, (27) 


can be regarded as a limit of the case of elastically fastened ends. In fact, 
let the stiffness of the springs binding the ends of the string to their initial 
positions increase without limit, i.e., let x; > 00, x,» 0. Then, dividing 
(23) by x, and (24) by x2, and taking this limit, we obtain the conditions (27). 


36.2. Least action ys. stationary action. The principle of least action is 
widely used not only in mechanics, but also in other branches of physics, 
e.g., in electrodynamics and field theory. However, as already noted (see 
Remark 2, p. 85), in a certain sense the principle is not quite true. For 
example, consider a simple harmonic oscillator, i.e., a particle of mass m 
oscillating about an equilibrium position under the action of an elastic 
restoring force (cf. Chap. 4, Prob. 2). The equation of motion of the par- 
ticle is 

mx + xx = 0, (28) 
with solution 
x = Csin (wt + 9), (29) 


AE 
Qo= _ 
m 


and the values of the constants C, @ are determined from the initial conditions. 
Moreover, the particle has kinetic energy 


where 


T = tmx? 
and potential energy 
U = hx’, 
so that the action is 
1 pts 
5 i) (mx? — xx?) dt. (30) 
to 


Equation (28) is the Euler equation of the functional (30), but in general 
we cannot assert that its solution (29) actually minimizes (30). In fact, 
consider the solution 


hig 
x = & sin wt, (31) 


which passes through the point x = 0, ¢ = 0 and satisfies the condition 
x(0) = 1. The point (x/w, 0) is conjugate to the point (0,0), since every 
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extremal satisfying condition x(0) = 0 intersects the extremal (31) at (1/w, 0) 
[see p. 114]. Since 


Fzn=m>0 


for the functional (30), the extremal (31) satisfies the sufficient conditions 
for a minimum (in fact, a strong minimum), provided that 


“9 
O<t<th<— 
q@ 


However, if we consider time intervals greater than m/w, we can no longer 
guarantee that the extremal (31) minimizes the functional (30). 
Next, consider a system of n coupled oscillators, with kinetic energy 


P= > any (32) 
k= 
(a quadratic form in the velocities x,;) and potential energy 


U= buXiXx (33) 


kal 


i] 


(a quadratic form in the coordinates x,). The quadratic form (32) is positive 
definite (since it is a kinetic energy); therefore, (32) and (33) can be simul- 
taneously reduced to sums of squares by a suitable linear transformation® 


x= > Cie Wk (= Vintec n), (34) 
k=1 


i.e., substitution of (34) into (32) and (33) gives 
To) G US > igh 
i=1 f=1 


Then the equations of motion of the system of oscillators are given by the 
Euler equations 

d (OT oUt, ; 
saa) 04: = qi + Ai =<! 0 (i — l, eis sg n), (35) 


corresponding to the action functional 


#y 2k hs 2 
J, 2@ — Na?) dt 


® See e.g., G. E. Shilov, op. cit., Secs. 72 and 73. The coordinates q, are often called 
normal coordinates, and the corresponding frequencies «, are called natural frequencies. 
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Suppose all the 4, are positive, which means that we are considering 
oscillations of the system about a position of stable equilibrium. Then 
the solution of the system (35) has the form 


q = C,sin w(t + 6) (j= 1,...,n), (36) 
where 
Qa, = Vu 


and the values of the constants C,, 8, are determined from the initial con- 
ditions. An argument like that made for the simple harmonic oscillator 
(n = 1) shows that a trajectory of the system [i.e., a curve given by (36) 
in a space of n + 1 dimensions] whose projection on the time axis is of length 
no greater than 7/w, where 
® = max wo, 
l<isn 

contains no conjugate points and satisfies the sufficient conditions for a 
minimum. However, just as before, we cannot guarantee that a trajectory 
whose projection on the time axis is of length greater than 7/w actually 
minimizes the action. 

Finally, consider a vibrating string of length / with fixed ends.’ As shown 
above, the function u(x, t) describing the oscillations of the string satisfies 
the equation 


Un(x, t) = a?u,,(x, t) 
and the boundary conditions 
u(0, r) = 0, u(/, t) = 0. 


It follows that® 


ux, t) = > C(x) sin w,(t + 9,,), 
k=1 
where 
oO, = > (37) 


and C,(x), 9, are determined from the initial conditions. Thus, in a certain 
sense, a vibrating string can be regarded as a system of infinitely many 
coupled oscillators, with natural frequencies (37). However, the numbers 
(37) have no finite upper bound, and hence the analogy with the case of n 
coupled oscillators leads us to believe that for a vibrating string, there is no 


7 Unlike the analysis of a system of 7 oscillators, the elementary argument that 
follows is meant to be heuristic rather than rigorous. 

8 See e.g., G. P. Tolstov, Fourier Series, translated by R. A. Silverman, Prentice-Hall, 
Inc., Englewood Cliffs, N. J. (1962), p. 271. 
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time interval short enough to guarantee that u(x, t) actually minimizes 
the action functional. Similar arguments can be carried out for other 
systems with infinitely many degrees of freedom. 

Guided by the above considerations, we shall henceforth replace the 
principle of /east action by the principle of stationary action. In other words, 
the actual trajectory of a given mechanical system will not be required to 
minimize the action but only to cause its first variation to vanish. 


36.3. The vibrating membrane. Consider the transverse motion of a 
membrane (i.e., a homogeneous flexible sheet) of surface mass density p. 
Let u(x, y, tf) denote the displacement from equilibrium of the point (x, y) of 
the membrane, at time t, The kinetic energy of the membrane at time ¢ is 
given by 


= 1 2; 
T= 5P J i: ui(x, y, t) dx dy, (38) 


where R is the region of the xy-plane occupied by the membrane at rest. 
The potential energy of the membrane in the position described by the 
function u(x, y, t), where ¢ is fixed, is just the work required to move the 
membrane from its equilibrium position u = 0 into the given position 
u(x, y, t). This work is the sum of the work U, expended in deforming the 
membrane and the work U, expended in moving the boundary of the mem- 
brane, which we assume to be elastically fastened to its equilibrium position. 

To calculate U,, let t denote the tension in the membrane, and consider the 
elementAA of the membrane initially occupying the region x) < x < X» + Ax, 
Yo <¥< Yo + Ay. Then, just as in the case of the string, the work needed 
to deform AA equals the product of t and the increase in the area of AA 
under deformation, i.e., 


+V (Ax)? + (Au)? V(Ay)? + (Au)? — +Ax Ay 
1 Au\? Au\? 
= 5 (=) + (=) ] ax4y Fores, (39) 
= 5 hl, Yo f) + wl, Yo, NIAXAY +o, 


where the dots indicate terms of order higher than those written. Integrating 
(39) over R, we find that the work required to deform the whole membrane is 


U, = ; t I [u2(x, y, t) + u2(x, y, t)] dx dy. (40) 
R 
To calculate U2, we generalize the argument used to derive (14). If I 


is the boundary of the region R, and s is arc length measured along [ from 
some fixed point on I’, then 


ties 5 [, outs, 0 ds, (41) 
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where is, t) is the displacement of the membrane from equilibrium at the 
point s and time ft, and x(s) is the linear density of the elastic modulus of 
the forces retaining the boundary of the membrane.® Combining (38), (40) 
and (41), we find that the action functional for the vibrating membrane is 


ty 
J[u] = fe (T — U, — U,) dt 
1 pts 2 2, 2 
= 5, ff, eubes ) — ttl, ». 0) + Whe» OD dx dy de (42) 


ty 
-5 [J 6) 2, 0 ade 
0 
Suppose we go from the function u(x, y, t) to the “‘ varied” function 
u*(x, Js t) ca u(x, y; t) + eh(x, ys t) ae 


Then, using formula (4) of Sec. 35 and dropping arguments of functions, we 
find that the variation 8/ of the functional (42) is 


are ff [pu + aes + yy) IY dx dy dt 
=e f I. xup ds dt — et I I, [= (u,b) + a wu] dx dydt 


+ef : ff. S (wy) dx dy de (43) 


Just as in the case of the vibrating string, we assume that the function 
u(x, y, t) is not varied at the initial and final times, i.e., that 


YX, Ys fo) = Y(x, Ys t) = 0. (44) 
Because of (44), the last integral in (43) vanishes. Moreover, using Green’s 
theorem in two dimensions (see p. 23), we have 


a 7) 
JJ, [ae eed + God] dx dy = [usb dy - wy dx) 
a3 Ou : . {te ou. ‘14 
= I, [Fe cos $+ | ds sin G + 9) a sin 3 « ) ds cos (5 + s)| 
Ou 
= Jind 
where 0/0n denotes differentiation with respect to n, the outward normal to 


I, and 9 is the angle between n and the x-axis. Thus, we can finally write 
(43) in the form 


ty ° 
SJ =e i: I, [—puu + tuse + uyy)]Y dx dy de 


—e {. [ (x + my ds dt. 


® More precisely, let the parametric equations of I be 


(45) 





x = x(s), y = ys), SoS SK Sy. 
Then «(s, tf) means u[x(s), y(s), t], and ‘‘the point s”” means the point (x(s), y(s)). 
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We first assume that 
st)=0 (el), (46) 


where ¢ is arbitrary, i.e., that « does not vary on the boundary of the mem- 
brane. Then (45) reduces to just 


87 = [ff Cpu + ter + tyy)l de dy at (47) 


Setting (47) equal to zero, and using the arbitrariness of the interval [fo, £,] 
and of the function ) = (x, y, ) inside R x [fo, t,], we find that 


tT 

ul W.) = lia ID + Mal O] (a ==) 48) 

for (x, y) € R and all ¢, a result known as the equation of the vibrating mem- 
brane.’° Equation (48) can also be written as 

Un(x, J; t) = a?V7u(x, y, t), 
in terms of the Laplacian (operator) 

oe a? 
2 = ——: 

v= aye t ae (49) 


Next, we remove the restriction (46). Since u(x, y, f) must satisfy (48), 
the first term in (45) vanishes, and we are left with 


a= - ef : {. [ous jes ead Us, t) ds de. (50) 


Then, since Y(s, t) is an arbitrary admissible function, equating (50) to zero 
leads to the formula’? 


u(syie(s, t) + ese =0 (GeD) (51) 


This is the boundary condition satisfied by a vibrating membrane when its 
boundary is elastically fastened to its equilibrium position. In particular, 
if the boundary of the membrane is free, x(s) = 0 and (51) becomes 


du(s, t) _ 
= ag =0 (s E rT), (52) 
while if the boundary of the membrane is fixed, x(s) = 0 and (51) becomes 


u(s, t) = 0 (seT). (53) 


10 By R x [fo, 4:] is meant the Cartesian product of R and [fo, f,], i.e., the set of all 
points (x, y, f) where (x, y) € R and ré [fo, f,]. 
11 The boundary conditions (51), (52) and (53) hold for all ¢. 
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36.4. The vibrating plate. Finally, we use the principle of stationary 
action to derive the equation of motion and the boundary conditions for the 
transverse vibrations of a plate (i.e., a homogeneous two-dimensional elastic 
body) with surface mass density p. As in the case of the vibrating membrane, 
let u(x, y, 1) denote the displacement from equilibrium of the point (x, y) of 
the plate, at time ¢. Then the kinetic energy of the plate at time ¢ is given by 


eae 
T= 50 ublx, 1) dx dy, (54) 


where R is the region of the xy-plane occupied by the plate at rest [cf. (38)]. 

The potential energy of deformation of the plate, which we denote by U,, 
depends on how the plate is bent, and hence involves the second derivatives 
Uzz, Uzy and uy,. Unlike the case of the membrane, it is assumed that no 
work is done in stretching the plate, so that U, does not involve u, and u,. 
Moreover, we require U, to be a quadratic functional in u,;, u,, and uy,,>? 
which does not depend on the orientation of the coordinate system. Then, 
since the matrix 


uz, Uzy! 














Uyz Uyy| 


has just two invariants under rotations, i.e., its trace and its determinant,** 
it follows that 


U, = If, [A(uz, + Uyy)? + Bz Uyy — uz,)] dx dy, (55) 


where A and B are constants. Equation (55) is usually written in the form 


U, = 50 [f [ede + uh) — 20 = wlan — ub de dy, (56) 


where c is a constant depending on the choice of units, and yu is an absolute 
constant (Poisson’s ratio) characterizing the material from which the plate is 
made. For simplicity, we set c = 1. 

In addition to the potential energy of deformation U,, the total potential 
energy of the plate may also contain a contribution U, due to bending 
moments with density m(s, f), prescribed on the boundary I of R, and a 
contribution U, due to external forces acting on R with surface density 
J (x, y, t) and on I with linear density p(s, t). This would give 


Uae cE ms, t) one ds, (57) 


12 This guarantees that the equation of motion of the plate is linear. 
13 See e.g., G. E. Shilov, op. cit., p. 106. 
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where 0/én denotes differentiation with respect to nm, the outward normal 
to TI, and?4 


Us = ff for tutes» dx dy + f pls, 1) ds. (58) 


Combining (54), (56), (57) and (58), we find that the action functional for 
the vibrating plate is 


ty 
J(u] =| (T — U, — Uz — Us) dt 
0 
lie p : P 
=5 is Ff, Cou? — eee + typ)? + 201 — wNleectyy — Wh) — 2ffe] dx dy at 


-[ [ (ru +m =) ds dt. (59) 


Unlike the corresponding expressions for the vibrating string and the 
vibrating membrane, (59) contains second derivatives of the unknown 
function u. The variation of (59) corresponding to the transition from 
u(x, y, t) to 


u*(x, yt) = u(x yt) + ed(xy y+ --: 
turns out to be (see Problems 4 and 5, p. 190) 


SJ = ef if (—puy — V'u — fyb dx dy dt 


a (60) 
+ef" f. [e - pyb + (M — m)s FE] ds at 
Here, 
M = — [pV7u + (1 — w)(Usexg + 2UyyXnVn + UyyVa)] (61) 
and 
P=>— oy aa (1 — ws 5, Wsa%nXs + Uzy(XnVs + XsYn) + UyyYnVs]s (62) 


where 0/én denotes differentiation in the direction of the outward normal 
to I’, with direction cosines x,, y,, and 0/@s denotes differentiation in the 
direction of the tangent to I’, with direction cosines x,, y,. Moreover, 


atu, Oty 
ax? dy? * ayt 


, 


atu 
Viu = V2(V2u) = axe + 2 = 5 


according to (49). 
We first assume that 


woo=0, M929 Gen, (63) 


14 An identical term might also have been included in the expression for the potential 
energy of the vibrating membrane. 
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where ¢ is arbitrary, i.e., that uw and its normal derivative do not vary on the 
boundary of the plate. Then (60) reduces to just 


BJ = ef i Ff, ema — Vie = fp dx dy dt (64) 


Setting (64) equal to zero, and using the arbitrariness of the interval [fo, t,] 
and of the function } = (x, y, f) inside R x [fo, 4], we obtain the equation 
for forced vibrations of the plate:75 


puy(x, ys D) + Viu(x, Vs ) a I(x, ys t) = 0. (65) 
If we set f = 0, so that there are no external forces acting on the plate, (65) 
reduces to the equation for free vibrations of the plate 


Puy (x, yt) + Viu(x, yt) = 0. 


Finally, if we set u, = O in (65) and assume that f = f(x, y) is independent 
of time, we obtain an equation for the equilibrium position of the plate 
under the action of external forces: 


Viu(x, y) + fy) = 0. 


This equation could have been obtained directly from the condition for the 
potential energy of the plate to have a minimum (see Remark 2 below). 

Next, we remove the restriction (63). Since u(x, y, t) must satisfy (65), 
the first term in (60) vanishes, and we are left with 


ae lf le — py) + (M — m) 2 dea. (66) 


Then, since the functions ), d)/0n and the interval [fo, ¢,] are arbitrary, 
equating (66) to zero leads to the natural boundary conditions 

P(s, t) = p(s, t) = 0, Ms, t) rh m(s, t) =0 (s € lr). (67) 
If the boundary of the plate is clamped, the conditions (67) are replaced by 


the “imposed” boundary conditions 


u(s, 1) = 0, as D9. GET): 





If the plate is supported, i.e., if the boundary of the plate is held fixed while 
the tangent plane at the boundary can vary, we obtain the boundary con- 
ditions 


u(s,t)} = 0, M(s,t) — m(s,t) = 0 (se T). 


18 When domains of arguments are not specified, it is understood that ¢ is arbitrary 
and (x, y)E R. 
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Remark 1. It should be noted that the Euler equation (65) does not involve 
the coefficient p. This is explained by the fact that the expression 


UzgUyy — uz, (68) 
is the divergence of the vector 
(uUyy, = UzUzy), 


and hence has no effect on (65). However, (68) does have a decisive effect 
on the boundary conditions, via the functions M(s, t) and P(s, t). 


Remark 2. For a mechanical system to be in equilibrium, its kinetic 
energy J must vanish and its potential energy U must be independent of 
time. Under these conditions, the principle of stationary action reduces to 
the assertion that SU = 0. Thus, the equilibrium position of the system 
corresponds to a stationary value of U. Moreover, it can be shown that this 
stationary value must be a minimum if the equilibrium is to be stable and 
hence physically realizable. In elasticity theory, this principle of minimum 
potential energy is often replaced by Castigliano’s principle, which states 
that the equilibrium position of an elastic body corresponds to a minimum 
of the work of deformation.® 


37. Variation of a Functional Defined on a Variable Region 


37.1. Statement of the problem. In Sec. 35, we derived a formula for the 
variation of the functional 


0 EE 


allowing only the function u (and hence its derivatives) to vary, while leaving 
the independent variables (and hence the region of integration R) unchanged. 
We now find the variation of the functional (69) in the general case where the 
independent variables x,,..., x, are varied, as well as the function uw and its 
derivatives. For simplicity, we use vector notation, writing x = (x,..., Xa), 
dx = dx, --- dx, and 


gradu = Vu = (u,,,..., Uz,)- 


With this notation, (69) becomes 
Jtu] = [FG uw Vu) de. (70) 
R 
16 For a detailed treatment of Castigliano’s principle and a proof of its equivalence 


to the principle of minimum potential energy, see e.g., R. Courant and D. Hilbert, 
Methods of Mathematical Physics, Vol. 1, Interscience, Inc., New York (1953), pp. 268-272. 
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Now consider the family of transformations?” 


xf = D,(x, u, Vu; e), 


u* = V(x, u, Vu;e), ee) 


depending on a parameter ec, where the functions ®; (i = 1,...,”) and ¥ 
are differentiable with respect to «, and the value « = 0 corresponds to the 
identity transformation: 


D(x, u, Vu; 0) = Xi, 
W(x, u, Vu; 0) = u. 


The transformation (71) carries the surface co, with the equation 


u = u(x) (x € R), 


(72) 


into another surface o*. In fact, replacing u, Vu in (71) by u(x), Vu(x), 
and eliminating x from the resulting n + 1 equations, we obtain the equation 


u* = u*(x*) (x* € R*) 
for o*, where x* = (x*,..., x*), and R* is a new n-dimensional region. 
Thus, the transformation (71) carries the functional J [u(x)] into 
J (u*(x*)] = i FO, ut, Vee) dict, 
R 
where 
V*u* = (uts,..., uFs). 


Our goal in this section is to calculate the variation of the functional (70) 
corresponding to the transformation from x, u(x) to x*, u*(x*), i.e., the 
principal linear part (relative to <) of the difference 


J[u*(x*)] — J[u(x)]. (73) 


37.2. Calculation of 5x; and 5u. As in the proof of Noether’s theorem for 
one-dimensional regions (see p. 82), suppose « is a small quantity. Then, 
by Taylor’s theorem, we have 








x = Ox, u, Vu; 2) = ®,(x, u, Vu; 0) + eA w Nuss) + ofc), 
e=0 
u* = V(x, u, Vu; e) = F(x, u, Vu 0) + Es + o(e), 
e=0 
or using (72), 
x¥ = x, + e9(x, u, Vu) + o(€), (74) 


u*¥ =u + ed(x, u, Vu) 4+ o(c), 


17 These formulas, with 7 independent variables and 1 unknown function, should be 
contrasted with the formulas (45) of Sec. 20, with 7 unknown functions and | independent 
variable. 
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where 
0D (x, u, Vuze 
9,(x, u, Vu) = BOM ty Vis €) 
OY (x, u, Vu; €) a (75) 
Ux, u, Vu) = A % Wie) 
ce e=0 
For a given surface o, with equation u = u(x), (74) leads to the increments 
Ax, = xf — x, = ep(x) + fe) (76) 
and 
Au = u*(x*) — u(x) = ef(x) + ofe), (77) 


where we explicitly indicate the arguments x and x* at which the functions 
u and u* are evaluated, and 9,(x), (x) denote the functions (75) with u, Vu 
replaced by u(x), Vu(x). Formula (77) gives an expression for the change in 
u-coordinate as we go from the point (x, u(x)) on the surface o to its image 
(x*, u*(x*)) under the transformation (74). The variations 5x, and du 
corresponding to (74) are defined as the principal linear parts (relative to e) 
of the increments (76) and (77), i.e., 


dx, = e¢,(x), du = ef(x). (78) 
We must also consider the increment 
Au = u*(x) bac u(x), 


i.e., the change in u-coordinate as we go from the point (x, u(x)) to the 
point (x, u*(x)) on the surface o* with the same x-coordinate, where o* is the 
image of the surface o under the transformation (74). Imitating (77) and 


(78), we introduce a new function ~(x) and a corresponding variation Su: 
Au = ut(x) — u(x) = (x) + of), 


du = ef(x). 
To find the relation between } and ¢, or equivalently, between 5u and 8u, 
we write 

Au = u*(x*) — u(x) = [ut(x*) — u*(x)] + [4*@) — uO)] 


2. Ou* = 
= >, Fe Ot — 1) + bu + of) 
= (79) 
n * Ls 
ay “ Bx, + Bu + o(€). 
1 


i=l 
Since éu*/dx, and du/dx, differ only by a quantity of order e, (79) becomes 
2. Ou — 
Au ~ palais 
u a By, Om + Bu, 


where the symbol ~ denotes equality except for terms of order higher than 1 
relative to «. But Au ~ 8u, since du is the principal part of Au, and hence 


Su = du + > u,, 9X). (80) 
f=1 
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Moreover, since 


du = eh, bu = eh, dx; = eD, 
(80) also implies 


pobt > U.P (81) 


Example. Let u be a function of a single independent variable x, and let 
(71) be the transformation 


x* = xcose — u(x) sine = x — eu(x) + ofe), 


u*(x*) = x sine + u(x) cose = ex + u(x) + ofc), ee) 


i.e., a counterclockwise rotation of the xu-plane about the small angle « = e. 
As shown in Figure 10, (82) carries the point (x,u(x)) on the curve y with 
equation u = u(x) into the point (x*, u*(x*)) 
on its image y* with equation u* = u*(x*). 
It follows from (82) that 


dx = —eu(x), du = ex (83) 
and 
Ax) = —u(x), U(x) = x. (84) 


In fact, the expressions (83) can be read 
directly off the figure, as the components of 
the vector joining the point (x, u(x)) to the 
point (x*, u*(x*)). Moreover, Ficure 10 





u*(x) = u*[x* + eu(x)] + o(e) = u*(x*) + eu(x)u*'(x*) + ofc), 
and since u*’(x*) and u’(x) differ only by a quantity of order c, we have 
u*(x) = u*(x*) + eu(x)u'(x) + of). 
On the other hand, according to the second of the formulas (82), 
u*(x*) = ex + u(x) + ofe). 
It follows that 


Au = u*(x) — u(x) = e[x + u'(x)u(x)] + of) 
and 
8u = e[x + u(x)n'(x)], 
x) = x + u(x)u'(x). 
Using (83) and (84), we can write (85) as 


(85) 


du = du + u’ 8x, 
y = } + u'g, 
in complete agreement with (80) and (81). 
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37.3. Calculation of 3u,,. We now derive an expression for the quantity 


du*(x*) — du(x) 
Ox} Ox, 





Au,, = 


or more precisely, its principal part 8u,,, which will be required later when 
we calculate the increment (73). First, we note that according to (74),*® 
Oxe 89K 
oe ~d, te Bx (86) 


where 8&,, is the Kronecker delta, equal to | if i = k and 0 otherwise. It 
follows that 


i.e., 
a rs) — a0, @ 
Bx, Sak ~ © 2, Oe Oak (87) 


Next we write 
du*(x*) — Ou(x) 


Au, = 
‘ Ox¥ Ox; 
O[u*(x*) — u(x*)]  O[u(x*) — u(x)] ) fr) ¥ 
ot Rs ae ee 


and analyze each of the three terms in the right-hand side separately. Using 
(87) and the fact that 


u*(x*) — u(x*) ~ ef(x*), 


we have 
Ofu*(x*) — ux*)] — Aur(x*) — u*)] HO") _ 24@). (88) 
ox* Ox, ~ Ox, Ox; 


Moreover, it is easily verified that 


O[u(x*) — u(x)] é a 
Ox; ~ Ox, > 


oe 





(xf — XK) ~ & 5 ex(x) (89) 


'k=1 


and 


ea 0 n a Q 5 OD, Cu(x) 
(5 - an) x aS (sa ~ s)ux) rae 2, ax, Oxi oo) 





18 In expressions like @p,/¢x,, u is regarded as a function, i.e., the value of wis not held 
fixed, as might be inferred from the somewhat ambiguous notation for partial derivatives. 
Actually, @p,,/éx, means 


~ «lx, u(x), Vu(x)]. 
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Adding equations (88), (89) and (90), we obtain 
* aK n a2 
eet du*(x*) — Ou(x) (2 a aS C7u on): (91) 


Oxi Ox, Ox, 4 Ox; Ox, 











Finally, recalling that 
Au,, ~ 8uz,, u = et, BX, = EDx, 
we can write (91) as 
Buz, = (Bu), + D> aay 8% (92) 
k=1 
37.4. Calculation of 5/. We are now in a position to calculate the varia- 
tion of a functional defined on a variable domain. 


THEOREM |. The variation of the functional 
J[u] = i F(x, u, Vu) dx (93) 
R 


corresponding to the transformation)® 
x*¥ = Ox, u, Vuse) ~ x, + e9,(x, u, Vu), 
u* = V(x, u, Vu;e) ~ u + ef(x, u, Vu) (94) 
(i = 1,..., 2”) ts given by the formula 
ane (F. = > a Fb dx+ef > “. (Fy) + Fo) dx, (95) 
where 


b = y ~ > Uz,9i- 


Proof. Were, 5J means the principal linear part (relative to ¢) of 
the increment 
AJ = J{u*(x*)] -— J[u(x)], (96) 


where u*(x*) is the image of u(x) under the transformation (94). By 
definition, (96) equals 
AJ = |, Fx ut, Vtut) dat — [ F(x, u, Vu) dx 
IR oR 


OCT, OR) 
A(x, eets | Xn) 


(97) 


=f [Fe ut, V*u*) F(x, u; vu)| dx, 


where 
a(x¥,..., x*) 


O(a, ---5 Xn) 





12 As usual, the symbol ~ denotes equality except for terms of order higher than 1 
relative to e. 
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is the Jacobian of the transformation from the variables x,,..., x, to 
the variables x¥,...,x*¥. According to (86), this Jacobian is 





691 ; Pz OP n 

De ae Ox, © ox, Ox, 
O93 O92 O9n 

OXe TES a2 OXe - OXe 
Of Ope Pn 

© Ox, ‘ OXn Eanes OXn 





and hence we can write (97) as 
As ~ | [Fos ut, veu)(1 +i > =) SG v)| dx. (98) 
R iS Ox, 


Using Taylor’s theorem to expand the integrand of (98), and retaining 
only terms of order | relative to «, we find that 


n ao 
J = i [> F,, 3x, + F, 8u + De uz, Uz, + cF >, =| dx. (99) 
Then, since 5x, = eq,, substitution of (80) and (92) into (99) gives 
ay = | [> F,, 8x, + Fu + Fy > us, 8x; + DE vz, Bi)z, (100) 


+ 2 Fy, Usjr, 8%e + F > (xi). dx. 
f=1 


As in the case of a fixed domain R, we try to represent the integrand 
of (100) as an expression of the form?° 


G(x) 8u + div (---) 
(cf. p. 153). This can be achieved by noting that 


Dae (F 8x.) = > F,, 8x; + > F(8x;):, 


i ni 


n 


n 
+ > Fyuz, 8x, + > Fy,Ur,2, 8X 
i ka 


=1 i, 1 
and 


De F,,,(8i)s, = Dae -(F,,, Ba) — > (= F.,) bu 


20 Then, because of the n-dimensional version of Green’s theorem [see formula (5)], 
the second term of (101) can be transformed into a surface integral. 
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(The last formula resembles an integration by parts.) Thus, finally, 
we have 


a= f (F. => x vn) Bi Bude + [i De Fe, Fu, Bu + F 8x) dx, (101) 


which is the same as formula (95), since 3u =e}, 8x, = e9,. This 
proves the theorem. 


Remark I, In the special case where the function u and its derivatives 
are varied, but not the independent variables x,, we have 


@ = 0, Vo Deano 
and (95) becomes 
ame (F. -> - Fu) 902) dx tel > - [F.,, Yoo] dx, 


which is identical with formula (4) of Sec. 35. 


Remark 2. The formula for the variation of the functional J[u] is ordinarily 
used in the case where u = u(x) is an extremal surface of J[u], i.e., satisfies 
the Euler equation 


a?) 
F,- p> Bx, Fin = 0. 

Then (95) reduces to 

= Fo,) @. 

SJ e| > a F,,,) + Fo) dx 
in the general case, and to 
aa) 
SJ =e a > By, (Fans#) ax 


in the case where the independent variables x, are not varied. 


Remark 3. Consider the functional 


Ou, _, Cem 
Hates F(x, ay 9 May Bebe us) de, (102) 
involving m unknown functions u,,..., u, and their derivatives 
ou; - A 
3x, G@=1,...,2;7 = 1,..., m). (103) 


Introducing the vector u = (u,,...,u,) and interpreting Vu as the tensor 
with components (103), we can still write (102) in the form 


J(u] = f F(x, u, Vu) dx. 
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Then, if (94) is replaced by the transformation 








x¥ = O(x, u, Vu; ©) ~ x, + ep(x, u, Vu) (i =1,...,7), (104) 
u¥ = V(x, u, Vuse) ~ u; + eb(x,u, Vu) (j= 1,...,m), 
the formula (95) generalizes to 
ul 20 OF - 
b= e/ > = ~ Die 2) , dx 
ewe ee (105) 
+e = b, + Fo;\ dx, 
ED ae fe afeny ° 
Ox, 


where 
be4- >a Gl 
7 = 4; Bx, 7 jJ=l,...,m). 
Remark 4, Let (104) be replaced by the more general transformation 
x¥ = Ox, u, Vu;e) ~ x + > e,00("(x, u, Vu) (= 1,..., 7), 
k=1 
uk = (x, u, Vuze) ~ uj; + > ep(x, u, Vu) V=1,...,m), 
k=1 
depending on r parameters ¢,...,¢,, where « means the vector (c,..., €,) 


and the symbol ~ denotes equality except for quantities of order higher than 
1 relative to ¢,,...,¢,. Then, formula (105) generalizes further to 





where 


We => Be kab 
$ 5 4: ax, "! Sa age 

37.5. Noether’s theorem. Using formula (95) for the variation of a 
functional, we can deduce an important theorem due to Noether, concerning 
‘invariant variational problems.” This theorem has already been proved 
in Sec. 20 for the case of a single independent variable. Suppose we have a 
functional 


J[u] = ie F(x, u, Vu) dx (106) 
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and a transformation 


xt or Ox, u, Vu), 


u* = V(x, u, Vu) 00) 


(i = 1, ..., m) carrying the surface o with equation uv = u(x) into the surface 
o* with equation u* = u*(x*), in the way described on p. 169. 
DEFINITION.?2! The functional (106) is said to be invariant under the 
transformation (107) if J[o*] = J[o], f.e., if 
I « F0x*, ut, Vtu*) dx = J F(x, u, Vu) dx. 
R R 


Example. The functional 


va [1 [QR + (3) ]o0 


is invariant under the rotation 


x* = xcose — ysine, 
y* = xsine + ycose, (108) 
u®* =u, 


where « is an arbitrary constant. In fact, since the inverse of the trans- 
formation (108) is 


x = x* cose + y* sine, 
y = —x* sine + y* cose, 
u=u*, 


it follows that, given a surface o with equation u = u(x, y), the “transformed” 
surface o* has the equation 


u* = u(x* cose + y* sine, —x* sine + y* cose) = u*(x*, y*). 


Consequently, we have 


r= fe 5) + EY Jere 
a ie (= cos — — 5 # sin c) + (= sine + 7 60s :) | dx* dy* 


= Jf) + BY] espace = FI [GY + By] aco 


THEOREM 2 (Noether). If the functional 


J{u) = i F(x, u, Vu) dx (109) 


21 Cf, the analogous definition on p. 80 and the subsequent examples. 
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is invariant under the family of transformations 


xk = O,(x, u, Vu; 2) ~ x, + e9(x, u, Vu), (110) 
u® = V(x, u, Vu;e) ~ u + eb(x, u, Vu) 


(¢ = 1, ...,7) for an arbitrary region R, then 


a) 
> Fy, Fuad + Fo) = 0 (11) 
on each extremal surface of J[u], where 
p = y oo ~ Uz,Qi- 
{=1 
Proof. According to formula (95), 


0 
sel, 2 Bx, Fanih + Feo) dx, 
if uw = u(x) is an extremal surface. Since J[u] is invariant under (110), 
dJ = 0, and since R is arbitrary, this implies (111), as asserted. 


Remark 1. If we drop the requirement that wu = u(x) be an extremal 
surface of J[u], then, using (95) again, we find that (111) is replaced by 


Be eg 
(FA, =D a Fd + D fe Fuad + Fp) = 0. 


Remark 2. If there are m unknown functions u,,...,U,, we introduce 
the vector u = (w4,...,U,) and continue to write (109), as in Remark 3, 
p. 175. Then invariance of J[u] under the family of transformations 


xF = Ox, u, Vu;e) ~ x, + €9,(x, u, Vu) (= 1,...,”), 
uy = ‘P(x, u, Vu5e) ~ u, + ef,(x, u, Vu) Gj = 1,...,m) 


implies that 





~ @ = OF 
Pa ax, (2 2) 
Ox, 


b+ = = 0, (112) 


where 


d = 
oe ( 2, Paid + Fe) =0 
or 
S Fash + (F ay WF} = const (113) 
j= rrs| 
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along each extremal. This is precisely the version of Noether’s theorem 
proved in Sec. 20. In other words, the left-hand side of (113) is a first 
integral of the system of Euler equations 


d 


F,, — a Pu 


,=0 VG = 1,...,m). 


Remark 3. Invariance of the functional (109) under the r-parameter family 
of transformations (see Remark 4, p. 176) 


xf = Ox, u, Vuse) ~ x + > €,0{(x, u, Vu) (= 1,...,n), 
k=1 

uf = V(x, u, Vu; ce) ~ u; + > ex, u, Vu) VG = 1,...,m) 
k=1 


implies the existence of r linearly independent relations 


2 (2 pa ernn|ze k=1..59, (114) 





where 
n 


Yo = yo — 2 oo of”, 

Remark 4. Suppose the functional J[u] is invariant under a family of 
transformations depending on r arbitrary functions instead of r arbitrary 
parameters. Then, according to another theorem of Noether (which will 
not be proved here), there are r identities connecting the left-hand sides of 
the Euler equations corresponding to J[u]. For example, consider the 
simplest variational problem in parametric form, involving a functional 


st ee 
Ihx, y] = f° OG», & I) dt (115) 


where ® is a positive-homogeneous function of degree | in x(t) and y(t) 
(see Sec. 10). Then, as already noted on p. 39, J[x, y] does not change if 
we introduce a new parameter + by setting ¢ = #(t), where dt/dt > 0, and 
in fact, the left-hand sides of the Euler equations 


d d 
Ss Se ®, — 7 Pv = 0 


corresponding to (115) are connected by the identity 


‘ d ; d = 
(0, _ ae o,) + (0 = ae ®,) = 0. 
Another interesting example of a family of transformations depending 


on an arbitrary function, i.e., the gauge transformations of electrodynamics, 
will be given in Sec. 39. 


®, 
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38. Applications to Field Theory 


38.1. The principle of stationary action for fields. In Sec. 36, we discussed 
the application of the principle of stationary action to vibrating systems with 
infinitely many degrees of freedom. These systems were characterized by 
a function u(x, t) or u(x, y, t) giving the transverse displacement of the system 
from its equilibrium position. More generally, consider a physical system 
(not necessarily mechanical) characterized by one function 


u(t, X1,..-, Xn) (116) 
or by a set of functions 


u(t, Xy,...5 Xn) (V=1,...,m), 
depending on the time ¢ and the space coordinates x,,..., X,.?2. Such a 
system is called a field [not to be confused with the concept of a field (of 
directions) treated in Chap. 6], and the functions u, are called the field 
functions. As usual, we can simplify the notation by interpreting (116) as 
a vector function uv = (u,,...,4u,) in the case where m> 1. It is also 
convenient to write 


t= Xo, X = (Xo, X1,.--5 Xn), Gx = dxp dx, --+ dXy. 


Then the field function (116) becomes simply u(x). 
In the case of the simple vibrating systems studied in Sec. 36, the equations 
of motion for the system were derived by first calculating the action functional 


ia (T — U) dt, 


where 7 is the kinetic energy and U the potential energy of the system, and 
then invoking the principle of stationary action. Similarly, many other 
physical fields can be derived from a suitably defined action functional. 
By analogy with the vibrating string and the vibrating membrane, we write 
the action in the form?* 


J[u, Vu) = [ dxo [+++ [ Lu Vu) dx, +++ dx, = [| 2, Vu) dx, (117) 


22 We deliberately write the argument ¢ first, since it will soon be denoted by xo. 
In physical problems, ” can only take the values 1, 2 or 3. However, the choice of m 
is not restricted, corresponding to the possibility of scalar fields, vector fields, tensor 
fields, etc. 

23 The aptness of this way of writing the action will be apparent from the examples. 
In the treatment of vibrating systems given in Sec. 36, we did not explicitly introduce 
the functions L = T— Uand %. Of course, in some cases, e.g., the vibrating plate, 
£ must involve higher-order derivatives. 
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where V is the operator 
(Sogo x) 
Oxo ax, : OXn : 
R is some n-dimensional region, and Q) is the “cylindrical space-time region” 
R x [a, 5], i.e., the Cartesian product of R and the interval [a, 5] (see footnote 
10, p. 164). The functions L(u, Vu) and #(u, Vu) are called the Lagrangian 
and Lagrangian density of the field, respectively. Applying the principle of 


stationary action to (117), we require that 8/ = 0. This leads to the Euler 
equations 





=0 (j=1,...,m), (118) 


which are the desired field equations. 


Example 1. For the vibrating string with free ends (x, = x2 = 0), we 
have m = n = 1, and 


L = 4(pu? — cuz) = d(eu?, — tui,) 
[cf. formula (16)]. 


Example 2. For the vibrating membrane with a free boundary [x(s) = 0] 
we have m = 1, n = 2, and 


L = 4[pug — r(uz + ui)] = tour, — tui, + u7,)] 
[cf. formula (42)]. 
Example 3. Consider the Klein-Gordon equation 
(CO — M*)u(x) = 0, (119) 


describing the scalar field corresponding to uncharged particles of mass M 
with spin zero (e.g., 7°-mesons). Here, (]denotes the D’ Alembertian (operator) 
o2 o2 o2 o? 


O=- ~aat ae oat ae 





It is easy to see that (119) is the Euler equation corresponding to the Lagran- 
gian density 


LH = (ui, — u?, — uz, — u2, — M?u?). (120) 


38.2. Conservation laws for fields. Noether’s theorem (derived in Sec. 
37.5) affords a general method of deriving conservation laws for fields, i.e., 
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for constructing combinations of field functions, called field invariants, 
which do not change in time. Thus, suppose the integral 


[ Lu, Vu) dx 
a 
is invariant under an r-parameter family of transformations?* 


x*¥ = O(x, u, Vuye) ~ 4% + Dee (i = 0, 1, 2, 3), 





(121) 
uk = (x, u, Vuse) ~ u; + De Vj = 1,...,m), 
where « = (€;,...,¢€,).. Then, according to Remark 3, p. 179, we have r 
relations of the form 
: 3. al” 
div I = pala MISE 
Zz Ox, , 
where 
m 
1% => 22 Jw Go k= 1.0) (122) 
are 
Ox, 
and 


(k) _ fe _ ou; (ie), 
$i = 25 $4 


Ox, 


These equations have the following interesting consequence: Suppose the 
cylinder Q = R x [a, b], where R is the three-dimensional sphere defined by 


x? + x2 + x2 < c?. 


Let I be the boundary of Q, and let v be the unit outward normal to I. 
Then, integrating each of the relations (122) over I and using Green’s 
theorem [formula (5) of Sec. 35], we obtain 


J div Idx = { (U®,v)de=0 (k=1,...,0). (123) 
Q r 


The surface integral in (123) is the sum of an integral over the lateral surface 
of the cylinder I and an integral over the two end surfaces cut off by the 
planes x9 = a, X) = 6. As c-—> ©, the integral over the lateral surfaces 
goes to zero (by the usual argument requiring that the field fall off at infinity 
‘sufficiently rapidly’’), and we are left with the integral over the end surfaces. 


24 From now on, we set 1 = 3. 
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On these surfaces, the scalar product (J, v) reduces to /§, where the plus 
sign refers to the “‘top”’ surface and the minus sign to the “‘bottom”’ surface. 
Therefore, taking the limit as c > © in (123), we find that 


[i (a, X1, X2, X3) dx dx2 dx, 
(124) 


= I) TS (b, x4, Xa, X) AX, dxy dx, (kK = 1,...,N) 


where J‘ denotes the xo-component of the vector 7“, and the integrations 
extend over all of three-dimensional space, as will always be assumed if no 
region of integration is indicated. Since a and Bb are arbitrary, it follows 
from (124) that the quantities 


| I dx, dxy dX, 


“|(? = es aoc (k=1,...,r) (125) 
j bbed d 





are independent of time. The r quantities (125) are the required field invari- 
ants, whose existence is implied by the invariance of the action functional 
under the r-parameter family of transformations (121). 


Remark. Ofcourse, all the functions in (125) are supposed to be evaluated 
on an extremal surface of the action functional, corresponding to a solution 
u(x) of the field equations (118). 


38.3. Conservation of energy and momentum. The action functional of 
any physical field is invariant under parallel displacements, i.e., under the 
family of transformations 


xf =x t+ & Gi =0, 1, 2, 3), 
u*¥ = u, V=1,...,m), 


(126) 
where the ¢, are arbitrary. In this case, we have 
8x; = &, du; = 0, 
which implies 
gi” = 91K, yw Se >: $8 =- 


where §,, is the Kronecker delta. According to (125), the corresponding 
field invariants are 


> ce Ou; _- L380 dx, dx, dx, (k = 0, 1, 2, 3). 
fi (32) OX 
OXo 
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It is convenient to introduce the second-rank tensor 





“= Of bu, 
Ty = 2 () es LBs, (127) 
ai 4 
Ox, 


called the energy-momentum tensor. In terms of 7,,, the field invariants are 


P= | To, dx, dx, dx,  (k = 0, 1,2, 3). 


The vector 
P = (Po, P1, Po, Ps) 


is called the energy-momentum vector, and in fact, it can be shown that Pp is 
the energy and P,, P., P; the momentum components of the field. Thus, 
since P is a field invariant, we have just proved that the energy and momen- 
tum of the field are conserved. 


38.4. Conservation of angular momentum. According to the special 
theory of relativity, the action functional of any physical field is invariant 
under orthochronous Lorentz transformations, i.e., under transformations of 
four-dimensional space-time which leave the quadratic form 


—x2 4+ x2 4+ x3 + x2 


invariant and preserve the time direction.2° For simplicity, we consider 
the case where u(x) is a scalar field (m = 1). Then the action functional 
must be invariant under the family of (infinitesimal) transformations 


xXF~ x + OD gutuxy 
i i pa USAT (128) 
u*¥ = u, 


where 


800 = —1, 811 = 822 = 833 = | 
and 


Ext = —€tr (k #1) (129) 


are the parameters determining the given transformation.?© Since the 
twelve parameters «,, (k # /) are connected by the relations (129), only six 
of them are independent, and we choose the independent parameters to be 
those for which k < l. 


25 The determinant of the matrix corresponding to a Lorentz transformation equals 
+1, where the plus sign corresponds to the so-called proper Lorentz transformations. 
Seee.g., V. I. Smirnov, Linear Algebra and Group Theory, translated by R. A. Silverman, 
McGraw-Hill Book Co., Inc., New York (1961), Chap. 7. 

26 The parameters 12, €:3, €23 are angles of rotation, while €o1, €o2, €09 are certain 
expressions involving the velocity of light and the velocity of one physical reference 
frame with respect to the other. 
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Corresponding to the transformations (128), we have 
3 
8x, = > Sukix, = >» 3 Buti SueX 
tt t#kk=0 


3 3 
= > > Burt 9ieX1 + > > Ln& xr SicX 


t<k k=0 k>t k=0 


3 
= >: > E(B S1eX1 — Bice 8Xx)s 


t<k k=0 


where 8;, is the Kronecker delta, and 


It follows that 
(ke. 13) 


2 = 81 SieX1 — ix SuXks 


“ du ou ou 
per = .) ax, (Bree SiXe — Bu SinX1) = Bx, Bin — ox, Burt 
1 


t=0 


where the pair of indices k, / plays the same role as the single index k in (121) 
and ranges over the six combinations 


0,1; 0,2; 0,3; 1,2; 1,3; 2,3. 
According to (125), the corresponding field invariants are 


a Lan ee 
2) Ox, Bee k dx, 8m 


Ox, 


(130) 
+ Ll an dix — Sx na] dx, dx2 dx, (k < 1). 


It is convenient to introduce the third-rank tensor 


of [a é 

Mi, = A) Fes BxxXk — Fe Bi + Hg dx — Bux Sure] (k < 2, 
Ox, 

Mia = — Min (k > J), (131) 


called the angular momentum tensor. By definition, M;,, is antisymmetric 
in the indices k and /. Using the expression (127) for the energy-momentum 
tensor (specialized to the case of scalar fields), we can write (131) as 


Mort = SicxXiTa — 8uXiTix- 
In terms of M,,., the field invariants are 


| Mow dx, dxz dx3 (k <1), 


a fact summarized by saying that the angular momentum of the field is 
conserved. 
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Example. Using the quantities g,,, we can write the Lagrangian density 
(120) corresponding to the Klein-Gordon equation in the form 


= -132(%)' - Lae 

27 \Ox; 2 : 

This leads to the energy-momentum tensor 

Ou Ou 

— Sit bx, ox, 
and the angular momentum tensor 


Ou Ou Ou 
Mie = 8 ax, (sux: = ax, — BinXr ay a) + LC gux, 84. — SreXi 81): 


Ti - £3, (132) 


The energy density ers to (132) is 


= M2y2, 
Too = 3 >) (se) + 5 Mu 
while the momentum density has the components 


Gu ou 
ok = By, Ox, (k = 1, 2, 3). 


38.5. The electromagnetic field. To illustrate the methods developed 
above, we now derive the equations of the electromagnetic field from a 
suitable Lagrangian density. The electromagnetic field is described by two 
three-dimensional vectors, the electric field vector E = (E, Ez, E3) and the 
magnetic field vector H = (H,, Hz, H3). In the absence of electric charges, 
Eand H are related by the familiar Maxwell equations 


oH OE 
curl E = Ty curl H = a (133) 
div H = 0, div E = 0, 


where 
= $8 aE, , Ey 
OX2 ax. 
= aE, OE, GE, _ OE, OEs 26) 
ces et Tom on oy One ae 





and similarly for div H, curl H. It is convenient to express E and H in 
terms of a four-dimensional electromagnetic potential {Aj} = (Ao, Ai, A2, A3),7" 
by setting 


E = grad Ay — 4, H = curl A, (134) 
Q 


27 Since the symbol A is reserved for the three-dimensional vector (A,, Ag, Aa), we 
denote the four-dimensional vector (Ao, A1, Az, Aa) by {4s}. A is sometimes called the 
vector potential and Ao the scalar potential. 
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where 
A= (Ai, Aa, As) 
and 
_ (@Ay 8Ay 8A0 
sad tom (ose Bre) 


The potential {A,} is not uniquely determined by the vectors E and H. 
In fact, E and H do not change if we make a gauge transformation, i.e., if 
we replace {4,} by a new potential {Aj} with components 


Ax) = Aj) + FO 2 (j = 0, 1,23), 


where X = (Xo, X1, Xe, X3) and f(x) is an arbitrary function. To avoid this 
lack of uniqueness, an extra condition can be imposed on {A,}. The 
condition usually chosen is 


_ GA OA, 
- Fe + div A = > 805 mf (135) 
and is known as the Lorentz condition. 

Next, we prove that the Maxwell equations (133) reduce to a single equa- 
tion determining the electromagnetic potential {A,}. First, we introduce the 
antisymmetric tensor H\,, whose matrix 

0 = Ey -—E, Te E; 
Ey 0 Hz ae Hy 
E, = Hy; 0 A, 
E; H, = Ay 0 
is formed from the components of E and H. It is easily verified that the 
formula relating H,; to the potential {A,} is 
0A; _ OA 


iy = Ox, ~ Ox, (136) 





In terms of the tensor H;,, we can write the Maxwell equations (133) in the 
form 


3 
> git = 0 (j= 0, 1, 2, 3), (137) 


oH, is oH, 4 OH, 


OX, Ox; ax, », 128) 








where in (138), 


Lik = 
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Substituting (136) into (137) and (138), and using the Lorentz condition (135), 
we find that (138) is an identity, while (137) reduces to 


OA; ace 0 G = 0, 1, 2, 3), (139) 
where [] is the D’Alembertian 


o? oe? a? o? 
= ~ ag + aa t ag + og 
Finally, we show that (139) is a consequence of the principle of stationary 
action,?® if we choose the Lagrangian density of the electromagnetic field 
to be 


1 2 2 
Ga h(E HY (140) 


Replacing E and H in (140) by their expressions (134) in terms of the electro- 
magnetic potential {A,}, we obtain 


1] 0A \? 
Laz [(eraa Ao ~ ix) — (curl ay]: (141) 


We shall only verify that the Euler equations 


3 Gg 
oy PG GSU (142) 


aA; &% of 241) 
Xi 


corresponding to (141) can be reduced to the form (139) for the component 
Ao, since the calculations for A,, A2,A3 are completely analogous. It 
follows from (141) that 


ae _ a _, 
cy ag 2) = 
a{ <2 
OXo 
ef (ps 7 241) 
(34) ~ An \@x, Axo)’ 
al £22 
Ox, 


Oxy 

Seen LL 

(=) 4m \0xg 0A, 
a{—22 

OXg 


28 Provided A satisfies the Lorentz condition. 
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Thus, for j = 0, (142) becomes 


of 2 OL 
Ao fs (240) 
Ox; 
7 1 [8A , GAy | Ay @ (8A,  @Ay OAs 
~~ ae lo? + Oe at aalact tae tell = 


According to the Lorentz condition (135), 
0A, , OA2 , OAs Ao 


Oke Oke. Oka OX 
and hence (143) reduces to 
_ BAe , By , Py , BAe 
ox2 ox? ox? “Oxe 
which is just (139), for j = 0. 


Remark 1. In deriving (139) from (141), we made use of the Lorentz 
condition (135). Instead, we could have introduced an additional term 
into the Lagrangian density by writing 


L = Bx + {(erad Ao — say — (curl 4)? — (div A-~? aa) } (144) 


= (JA, = 0, 


which reduces to (141) if the Lorentz condition is satisfied. The Euler 
equations corresponding to (144) reduce to (139) for arbitrary {A,}. 


Remark 2. The Lagrangian density of the electromagnetic field, and hence 
its action functional, is invariant under parallel displacements, Lorentz 
transformations and gauge transformations. According to Sec. 38.3, the 
invariance under parallel displacements implies conservation of energy and 
momentum of the field, while, according to Sec. 38.4, the invariance under 
Lorentz transformations implies conservation of angular momentum of the 
field. Moreover, according to Remark 4, p. 179, the invariance under gauge 
transformations (which depend on one arbitrary function) implies the exis- 
tence of a relation between the left-hand sides of the corresponding Euler 
equations (139). Therefore, these equations do not uniquely determine 
the electromagnetic potential {A,}. In fact, to determine {A,} uniquely, 
we need an extra equation, which is usually chosen to be the Lorentz condition 
(135).?9 


22 The Maxwell equations are actually invariant under a 15-parameter family (group) 
of transformations. In addition to the 10 conservation laws already mentioned (energy, 
momentum and angular momentum), this invariance leads to 5 more conservation laws, 
which, however, do not have direct physical meaning. For a detailed treatment of this 
problem, see E. Bessel-Hagen, Uber die Erhaltungssdtze der Elektrodynamik, Math. Ann., 
84, 258 (1921). 
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PROBLEMS 


1, Find the Euler equation of the functional 


Hol =f so" | DS wedi sedne 
Riz. 
2. Find the Euler equation of the functional 
J(u) = fhe V1 + u2 + u2 + u2 dx dy dz. 


3. Write the appropriate generalization of the Euler equation for the 
functional 


J(u) = J I, F(x, Y, Uy Uz, Uy, Uz2, Ury, Uyy) ax dy. 


4. Starting from Green’s theorem 


[f.(2-F) acay =| wax + oa, 


prove that 
Je Bbara = [f,vBbeem + [ (6 -eiha. 
Ife Ghana — ff 08s Bacar [98 3) 
SJearapdeo = ff vad dee —3 (eae oz) 


+3 f(x a 32) dy. 


5. Let J[u] be the functional 
t 
ath [—(usz + Uyy)? + 201 — p)(urrttyy — uz,)) dx dy dt. 
‘0 R 


Using the result of the preceding problem, prove that if we go from u tou + ed, 
then 


en ae ff cvwy dx dy dt + ¢ (3 I [Pens + Mw) =] ds dt, 


where M(u) and P(u) are given by formulas (61) and (62). 


Hint. Express 0)/ax, 0p/dy in terms of 04/8n, Op/ds, and use integration 
by parts to get rid of Op/ds. 


6. Show that when a = 1, formula (105) of Sec. 37.4 reduces to formula (7) 
of Sec. 13. 


7. Given the functional 
J[o] = [fe ou atx dy, 


compute J[s*] if o* is obtained from o by the transformation (108). 
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8. Derive the Euler equations corresponding to the Lagrangian density 


f 2 Ou 2 M2y2 = : 0A; 2 M 2 2 
= 2 & (Se - eA.) + ue + 2, 2, ExE; (=) + pa aA;, 
where the field variables are u, Ap, Ai, Ao, Az, and the factor e; equals 1 
if i = Oand —1 if i = 1, 2,3. 


9. Show that the Lagrangian density Y of the preceding problem is Lorentz- 
invariant if u transforms like a scalar and if Ap, A,, Ao, Ag transform like the 
components of a vector under Lorentz transformations. Use this fact to 
derive various conservation laws for the field described by Y. 
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DIRECT METHODS 
IN THE 
CALCULUS OF VARIATIONS 


So far, the basic approach used to solve a given variational problem 
(and indeed, to prove the existence of a solution) has been to reduce the prob- 
lem to one involving a differential equation (or perhaps a system of differen- 
tial equations). However, this approach is not always effective, and is 
greatly complicated by the fact that what is needed to solve a given varia- 
tional problem is not a solution of the corresponding differential equation 
in a small neighborhood of some point (as is usually the case in the theory of 
differential equations), but rather a solution in some fixed region R, which 
satisfies prescribed boundary conditions on the boundary of R. The 
difficulties inherent in this approach (especially when several independent 
variables are involved, so that the differential equation is a partial differential 
equation) have led to a search for variational methods of a different kind, 
known as direct methods, which do not entail the reduction of variational 
problems to problems involving differential equations. 

Once they have been developed, direct. variational methods can be used to 
solve differential equations, and this technique, the inverse of the one we 
have used until now, plays an important role in the modern theory of the 
subject. The basic idea is the following: Suppose it can be shown that a 
given differential equation is the Euler equation of some functional, and 
suppose it has been proved somehow that this functional has an extremum 
for a sufficiently smooth admissible function. Then, this very fact proves 
that the differential equation has a solution satisfying the boundary con- 


ditions corresponding to the given variational problem. Moreover, as we 
192 
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shall show below (Sec. 41), variational methods can be used not only to 
prove the existence of a solution of the original differential equation, but also 
to calculate a solution to any desired accuracy. 


39. Minimizing Sequences 


There are many different techniques lumped together under the heading 
of ‘“‘direct methods.” However, the direct methods considered here are all 
based on the same general idea, which goes as follows: 

Consider the problem of finding the minimum of a functional J[y] defined 
on a space 4 of admissible functions y. For the problem to make sense, 
it must be assumed that there are functions in 4 for which J[y] < +0, 
and moreover that?! 


inf J[y] =u > —o, (1) 
y 
where the greatest lower bound is taken over all admissible y. Then, by 


the definition of p, there exists an infinite sequence of functions {y,} = 
V1, Yo,..., Called a minimizing sequence, such that 


jim J[¥n] = b. 


If the sequence {y,} has a limit function ¥, and if it is legitimate to write 


JL] = lim JUyeh @) 
i.e., 
J{lim y,] = lim J[y,], 
then 


J(¥] =u, 
and / is the solution of the variational problem. Moreover, the functions 
of the minimizing sequence {y,} can be regarded as approximate solutions 
of our problem. 

Thus, to solve a given variational problem by the direct method, we must 

1. Construct a minimizing sequence {y,}; 

2. Prove that {y,} has a limit function jy; 

3. Prove the legitimacy of taking the limit (2). 

Remark 1. Two direct methods, the Ritz method and the method of finite 
differences, each involving the construction of a minimizing sequence, will 
be discussed in the next section. We reiterate that a minimizing sequence 
can always be constructed if (1) holds. 


1 By inf is meant the greatest lower bound or infimum. 
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Remark 2. Even if a minimizing sequence {y,} exists for a given varia- 
tional problem, it may not have a limit function §. For example, consider 
the functional 


Jy = [xy 
[y] age xX, 


where 
W-1I)=-1l Y= 1. (3) 
Obviously, J[y] takes only positive values and 
inf J[y] = 0. 
We can choose ° 
YalX) = ane Ged 2c) (4) 


as the minimizing sequence, since 
i n*x? dx é 1 ii dx 2 
-1 (tan-! n)°(1 + n?x?)? ~ (tan-2n)?J-1 1+ 7x?” ntan— an 


and hence J[y,] > 0asn—>0o. Butasn— o, the sequence (4) has no limit 
in the class of continuous functions satisfying the boundary conditions (3). 

Even if the minimizing sequence {y,} has a limit » in the sense of the 
@-norm (i.e., ¥,—> J as n—> 0, without any assumptions about the convergence 
of the derivatives of y,), it is still no trivial matter to justify taking the limit 
(2), since in general, the functionals considered in the calculus of variations 
are not continuous in the @-norm. However, (2) still holds if continuity 
of J[y] is replaced by a weaker condition: 


THEOREM. If {y,} is a minimizing sequence of the functional J[y], with 
limit function ¥, and if Jy] is lower semicontinuous at j,? then 


J{9] = lim JLy5]. 
Proof. On the one hand, 
J[§] > lim Jl.) = inf JL} (5) 
while, on the other hand, given any « > 0, 
J{yn] — IV] > —e, (6) 
if n is sufficiently large. Letting n— oo in (6), we obtain 
JUS] < lim JD] + 6, 


or 
JTF] < lim Jiy], (7) 


2 See Remark |, p. 7. 
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since e is arbitrary. Comparing (5) and (7), we find that 


as asserted. 


40. The Ritz Method and the Method of Finite Differences® 


40.1. First, we describe the Ritz method, one of the most widely used direct 
variational methods. Suppose we are looking for the minimum of a func- 
tional J[y] defined on some space -4 of admissible functions, which for 
simplicity we take to be a normed linear space. Let 


P1, Qa,--s (8) 


be an infinite sequence of functions in 4, and let 4, be the n-dimensional 
linear subspace of .@ spanned by the first of the functions (8), i.e., the set 
of all linear combinations of the form 


P71 Pieised AnPns (9) 


where o,,...,%, are arbitrary real numbers. Then, on each subspace .%,, 
the functional J[y] leads to a function 


J[arpr +++ + OnPa] (10) 


of the n variables «,,..., «,. 

Next, we choose a,...,a, in such a way as to minimize (10), denoting 
the minimum by u, and the element of .#, which yields the minimum by y,. 
(In principle, this isa much simpler problem than finding the minimum of the 
functional J[y] itself.) Clearly, u, cannot increase with a, i.e., 


ey 2 Uo 2 fait, 


since any linear combination of 9,..., 9, is automatically a linear combi- 
nation 91, ..., Qn, @n+1- Correspondingly, each subspace of the sequence 


M,, My... 


is contained in the next. We now give conditions which guarantee that the 
sequence {y,} is a minimizing sequence. 


DEFINITION. The sequence (8) is said to be complete (in ) if given 
any ye M andanye > 0, there is a linear combination 7, of the form (9) 
such that ||y, — y|| < © (where n depends on «). 


3 Here we merely outline these two methods, without worrying about questions of 
convergence, and taking for granted the existence of an exact solution of the given 
variational problem. 
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THEOREM. [If the functional J[y] is continuous,* and if the sequence (8) 
is complete, then 


lim pu, =u, 
where 
u = inf J[y]. 
y 


Proof. Given any « > 0, let y* be such that 
JD‘) <ute. 


(Such a »* exists for any « > 0, by the definition of u.) Since J[y] is 
continuous, 


lJ{y] - JLy*ll < «, (11) 


provided that ||y — y*|| < 3 = Sc). Let y, be a linear combination of 
the form (9) such that |y, — y*|| < 8. (Such an y, exists for suffi- 
ciently large n, since {@,} is complete.) Moreover, let y, be the linear 
combination of the form (9) for which (10) achieves its minimum. 
Then, using (11), we find that 


u <J[yn] < Ilha] < w + 2. 
Since e is arbitrary, it follows that 
lim J[y,] = lim pu, =p, 
as asserted, _ oe 
Remark 1. The geometric idea of the proof is the following: If {,} is 
complete, then any element in the infinite-dimensional space “4 can be 


approximated arbitrarily closely by an element in the finite-dimensional 
space 4, (for large enough x). We can summarize this fact by writing 


lim M, = AM. 


Let » be the element in 4 for which J[}] = yu, and let p, €.#, be a sequence 
of functions converging to . Then {¥,} is a minimizing sequence, since 
J[y] is continuous. Although this minimizing sequence cannot be con- 
structed without prior knowledge of ~, we can show that our explicitly 
constructed sequence {y,} takes values J[y,] arbitrarily close to J[,], and 
hence is itself a minimizing sequence. 


Remark 2. The speed of convergence of the Ritz method for a given 
variational problem obviously depends both on the problem itself and on 


4 ].e., continuous in the norm of .4. For example, functionals of the form 


b 
JU] = |” Fe, yy) dx 


are continuous in the norm of the space #,(a, b). 
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the choice of the functions 9,. However, it should be pointed out that 
in many cases, linear combinations involving only a very small number of 
functions 9, are enough to give a quite satisfactory approximation to the 
exact solution. 


Remark 3. More generally, the spaces “ and .4, need not be normed 
linear spaces themselves, but only suitable sets of admissible functions 
belonging to an underlying normed linear space # (see Remark 3, p. 8). 
For example, the admissible functions may satisfy boundary conditions like 


yYa)= A, YWb)=B 
(see Sec. 40.2), or a subsidiary condition like 


i y?(x) dx = 1 


(see Sec. 41). This case can be handled by appropriate modifications of 
the present method. 


40.2. We now describe another method involving a sequence of finite- 
dimensional approximations to the space 4. This is the method of finite 
differences, which has already been encountered in Sec. 7. There, in con- 
nection with the derivation of Euler’s equation, we noted that the problem 
of finding an extremum of the functional® 


IDL = [FO yy)dx, WO) = A, (0) = B, (12) 


can be approximated by the problem of finding an extremum of a function 
of n variables, obtained as follows: We divide the interval [a, 6] inton + 1 
equal subintervals by introducing the points 


Xo = GA, X1y-+-5 Xn, Xn+1 = 5, X41 — X = Ax, 
and we replace the function y(x) by the polygonal line with vertices 


(Xo; Yo); (x1, yu) sey (%n Yn) (Xn42 Yn+r)s 


where now y, = y(x;). Then (12) can be approximated by the sum 
2S Fl yy 
I(N1 ~~ +) Yn) = > F [xu % Ax ]o (13) 


which is a function of variables. (Recall that y. = A and y,,, = Bare 
fixed.) If for each n, we find the polygonal line minimizing (13), we obtain 
a sequence of approximate solutions to the original variational problem. 


5 Here, -4 will be a linear space only if A = B = 0 (cf. Remark 3). 
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41. The Sturm-Liouville Problem 


In this section, we illustrate the application of direct variational methods 
to differential equations (cf. the remarks on p. 192), by studying the follow- 
ing boundary value problem, known as the Sturm-Liouville problem: Let 
P = P(x) > Oand Q = Q(x) be two given functions, where Q is continuous 
and P is continuously differentiable, and consider the differential equation 


—(Py'y’ + Oy = ry (14) 
(known as the Sturm-Liouville equation), subject to the boundary conditions 
ya)=0, yb) = 0. (15) 


It is required to find the eigenfunctions and eigenvalues of the given boundary 
value problem, i.e., the nontrivial solutions® of (14), (15) and the correspond- 
ing values of the parameter A. 


THEOREM. The Sturm-Liouville problem (14), (15) has an infinite 
sequence of eigenvalues , ,..., and to each eigenvalue there 
corresponds an eigenfunction y™ which is unique to within a constant 
factor. 


The proof of this theorem will be carried out in stages, and at the same 
time we shall derive a method for approximating the eigenvalues ‘” and 
eigenfunctions y™. 


41.1. We begin by observing that (14) is the Euler equation corresponding 
to the problem of finding an extremum of the quadratic functional 


Ji) = f° @y? + Oy) ds, (16) 


subject to the boundary conditions (15) and the subsidiary condition’ 
1) 
| ydx =I. (17) 


Thus, if y(x) is a solution of this variational problem, it is also a solution 
of the differential equation (14), satisfying the boundary conditions (15). 
Moreover, y(x) is not identically zero, because of the condition (17). 

Next, we apply the Ritz method (see Sec. 40.1) to the functional (16), first 


®In other words, the solutions which are not identically zero. For any value of 4, 
(14) and (15) are trivially satisfied by the function y(x) = 0. 
7 Use the theorem on p. 43, changing A to —A. 
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verifying that it is bounded from below, as required [cf. formula (1)]. Since 
P(x) > 0, this fact follows from the inequality 


b b b 
[ @y? + Oy) dx > [ Oyrdx > Mf’ ydx = M, 
where 
M= min Q(x). 


a<z<b 


For simplicity, we assume that a = 0, b = x, and we choose {sin x} as the 
complete sequence of functions {p,(x)} used in the Ritz method. This 
sequence also has the desirable feature of being orthogonal, i.e., 


ik sin kx sin Ix dx = 0 (k #2). 

QO 

If a linear combination 
>, a sin kx (18) 
k=1 


is to be admissible, it must satisfy the conditions (15) and (17). The condition 
(15) is automatically satisfied by our choice of the functions sin nx, but (17) 
leads to the requirement 


Kt S: ay sin kx) dx =5 S a? = 1. (19) 
O\ KS1 k=1 


Moreover, for a linear combination (18), the functional J/[y] reduces to 


Iuloay 4) = f [Peo > ate sin kx)” + we | > ay sin kx) ] dx, 
= = (20) 


which is a function of the n variables «,,..., a, (in fact, a quadratic form 
in these variables. 

Thus, in terms of the variables «,,...,«,, our problem is to minimize 
J (41, .. +; &,) on the surface o, of the n-dimensional sphere with equation (19). 
Since a, is a compact set and J,(a, ..., &) is continuous on o,, J,(%),..., &) 
has a minimum AY at some point «§”, ..., « of 6,.2 Let 


n 
yP(x) = > of sin kx 
k=1 


be the linear combination (18) achieving the minimum A‘. If this procedure 
is carried out for n = 1, 2,..., we obtain a sequence of numbers 


AY, WP, 6, (21) 
and a corresponding sequence of functions 


YX) Y2"(X), --- (22) 


® See e.g., T. M. Apostol, op. cit., Theorem 4-20, p. 73. 


200 DIRECT METHODS IN THE CALCULUS OF VARIATIONS CHAP. 8 


Noting that o, is the subset of o,,, obtained by setting «,,, = 0, while 


J,(a1, some On) = Ina ilea, seey hny 0), 
we see that 
Anes SAR, (23) 


since increasing the domain of definition of a function can only decrease its 
minimum. It follows from (23) and the fact that J[y] is bounded from below 
that the limit 

AY = lim »AY (24) 


exists. 


41.2. Now that we have proved the convergence of the sequence of 
numbers (21), representing the minima of the functional 


[ @y? + Op) dx 


on the sets of functions of the form 
n 
>: a, sin kx 
k=1 


satisfying the condition (19), it is natural to try to prove the convergence 
of the sequence of functions (22) for which these minima are achieved. We 
first prove a weaker result: 


Lemma 1. The sequence {y? 


subsequence. 


x)} contains a uniformly convergent 


Proof. For simplicity, we temporarily write y,(x) instead of yQ(x). 
The sequence 


ne = J" (Py? + Oyd dx 
is convergent and hence bounded, i.e., 
ic (Pyn + Qyn) dx < M 
for all n, where M is some constant. Therefore 
ie Py? dx <M + i Oy? dx_| < M+ max |Q(x)| = Mi, 


and since P(x) > 0, 


x M 
#2. 1 = 
I, Yn(x) dx < min P(x) Ma (25) 
a<i<t 
Using (25), the condition 
yn(O) a 0, 


and Schwarz’s inequality, we find that 


z 2 er = 
Inco? =| f° x@ az)’ < [yee de f° dé < Mon, 


z 
ie) 
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so that {y,(x)} is uniformly bounded.° Moreover, again using Schwarz’s 
inequality, we have 


z. 2 r. 
[yaGea) — yGea)l? = | J x00 de] < fy? dx 





ay 
i) dx| < M.|x2 — x,|, 
71 


so that{y,(x)} is equicontinuous.!° Thus, according to Arzela’s theorem,??! 
we can select a uniformly convergent subsequence {y,,(x)} from the 
sequence {y,(x)} and Lemma | is proved. 


We now set 
yP(x) = lim y,,,(x). (26) 


Our object is to show that y™(x) satisfies the Sturm-Liouville equation (14) 
with 4 = 4°?. However, we are still not in a position to take the limit as 
m-> oo of the integral 


[ eye + Ov.) ax, 


since as yet we know nothing about the convergence of the derivatives y,_. 
Therefore, the fact that for each m, the function y,,, minimizes the functional 
J[y] for y in the n,,-dimensional space spanned by the linear combinations 


Tm 

> a, sin kx 

k=1 
[subject to the condition (19) with n = n,,} still does not imply that the limit 
function y™(x) minimizes J [y] for y in the full space of admissible functions. 
To avoid this difficulty, we argue as follows: 


LEMMA 2. Let y(x) be continuous in [0, 7], and let 


[ [—(Ph’)’ + O,hly dx = 0 (27) 


2 A family of functions Y’ defined on [a, 5] is said to be uniformly bounded if there is 
a constant M such that 
Iv()| < M 
for all Pe¥ and alla <x < 5. 
10 A family of functions Y’ defined on [a, 5] is said to be equicontinuous if given any 
e > O, there is a § > O such that 


Ib(x2) — Hx) < € 
for all } e ¥’, provided that |x2 — x:| < 8 


11 Arzela’s theorem states that every uniformly bounded and equicontinuous sequence 
of functions contains a uniformly convergent subsequence (converging to a continuous 
limit function). Seee.g., R. Courant and D. Hilbert, op. cit., vol. 1, p. 59. 
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for every function h(x) € G0, x),)* satisfying the boundary conditions 
(0) = A(x) = 0, h'(0) = h(n) = 0. (28) 
Then y(x) also belongs to G.(0, x), and 
—(Py'y’ + Qiy = 0. 
Proof. If we integrate (27) by parts and use (28), we find that 
[ [-(Ph')' + Qyh]y dx = — i Ph'y dx — [ Pth'ydx + ie Oshy dx 


--{" [- Py + | Pydé + | ( j. Q,y at) dé] dx = 0. 


It follows from Lemma 3, p. 10 that 
= Zz 5 

—Py + [ Py dé + f (| Ory at) de=t +x, (29) 
Q 0 QO 


where cy and c, are constants. Since the right-hand side and the 
second and third terms in the left-hand side of (29) are obviously 
differentiable, (Py)’ exists, and in fact, differentiating (29) term by term, 
we find that 


—(Pyy + Py + | Ouydé = ay. (30) 


Since the function P is continuously differentiable and does not vanish, 
y’ exists and is continuous. Thus, (30) reduces to 


—Py' + | Quydé = cr. G1) 


Since the right-hand side and the second term in the left-hand side of (31) 
are differentiable, it follows that (Py’)’ exists, and in fact 

—(Py'Y + Qiy = 0, 
as asserted. Moreover, by the same argument as before, y” exists and is 
continuous. 


41.3. We can now show that the function y“(x) defined by (26), whose 
existence follows from Lemma |], satisfies the Sturm-Liouville equation 


— (Py?) + Oy” — ADYM, (32) 


where A‘ is the limit (24). According to the theory of Lagrange multipliers 
(cf. footnote 7, p. 43), at the point («{,..., a) where the quadratic form 
(20) achieves its minimum subject to the subsidiary condition (19), we have 


Fe {Ines ya yo (> % sin kx) ‘} dx = 0 (ry =1,...,n). 


12 L.e., for every A(x) with continuous first and second derivatives in [0, 7]. 
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This leads to the n equations 


I e {P | 2 aj. °(sin kx) (sin rx)’ 


+ [O(x) - | > af) sin kx] sin rx} dx =0 (r= 1,...,7). 
k=1 


(33) 


Multiplying each of the equations (33) by an arbitrary constant C{” and 
summing over r from | to n, we obtain 


[Leys + (Q — 2)yqhq] dx = 0, (34) 
0 


where 
A,(x) = > Cf sin rx. (35) 


r=1 


An integration by parts transforms (34) into 
I [—(Ph,)’ + (Q — AM] yn ax = 0. (36) 


If A(x) is an arbitrary function in D,(0, 7) satisfying the boundary conditions 
(28), we can choose the coefficients C\” in such a way that 


h, => h, h,=>h, hi, > h" 


(see Prob. 8). Here, the symbol = denotes convergence in the mean, i.e., 
h,, > h stands for 


lim f "Vig(x) — h(x)|2 dx = 0 
n+@ ~0 
Since yP —> y uniformly in [0, x],?° it follows from (36) that 
Him [" [—(Phig)’ + (2 — 2 Ving YD dx 
m+o 40 
= |, [-(@ay + — 2 hyp dx = 0 
(see Prob. 9). The fact that y‘Y is an element of Y,(0, x) and satisfies the 
Sturm-Liouville equation (32) is now an immediate consequence of Lemma 2, 
with 0, = 9 — 2%. 


So far, the function y(x) has been defined as the limit of a subsequence 
{yx} of the original sequence {y{(x)}. We now show that the sequence 





13 We now restore the superscript on y@. 
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{y(x)} itself converges to yx). To prove this, we use the fact that fora 
given 4, the solution of the Sturm-Liouville equation 


—(Py' + Qy = ry (37) 
satisfying the boundary conditions 
0) =0, y(n) =0 (38) 
and the normalization condition 
[ ye) dx = 1 (39) 


is unique except for sign. Let y(x) be a solution of (37) corresponding 
to > =X, and suppose y?(xo) # 0 at some point Xo in [0,7]. Then 
choose the sign so that y(x,) > 0. Similarly, let yx) be a solution 
of (37) corresponding to A = A‘, and choose the signs so that y('(x,) > 0 
for all n. If y2(x) does not converge to y(x), we can select another 
subsequence from {y(2(x)} converging to another solution (x) of (37), 
where again } = A‘. Because of the uniqueness (except for sign) of 
solutions of (37), subject to (38) and (39), this means that 


F(x) = — (a), 
and hence (xo) < 0, which is impossible, since yx.) > 0 for all nx. 
Therefore, y‘'(x) > y?(x) [in fact, uniformly], provided we choose each 
y(x) with the proper sign. 
41.4. We have just proved that the Sturm-Liouville problem has the eigen- 
function y'(x), corresponding to the eigenvalue 4°”. The ‘“‘next” eigen- 


function y(x) and the corresponding eigenvalue X‘” can be found by 
minimizing the quadratic functional 


Jly] = f° (Py? + Oy?) dx (40) 


subject to the same conditions (38) and (39) as before, plus an extra orthog- 
onality condition 


[ yy) ax = 0. (41) 
In fact, substituting 
yx) = > a, sin kx (42) 
k=1 


into (40), we again obtain the quadratic form J,(o,,..., %n) given by (20), 
but this time we study J,(a,,..., @,) on the set of functions of the form (42) 
which not only lie on the n-dimensional sphere a, with equation (19), thereby 
satisfying the normalization condition (39), but are also orthogonal to the 
function 


nr 
yP(x) = > aP sin kx, 
k=1 
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i.e., satisfy the condition 
> a [sin kx (> af? sin tx) dx = FY al? =O 43) 
K=1 0 f=1 K=1 


This is the equation of an (mn — 1)-dimensional hyperplane, passing through 
the origin of coordinates in n dimensions. Its intersection with the sphere 
(19) is an (x — 1)-dimensional sphere c,_,. By the same argument as before 
(cf. footnote 8), J,(a1,...,a,) has a minimum A on a,_,._ It is not hard 
to see that 

AL <P 


[cf. (23)], and hence the limit 


(2) — Jy 2) 
A = lim AG 


exists, since J[y] is bounded from below. Moreover, it is obvious that 


AY <A, (44) 
Now let 


n 
YO = > of) sin kx 
k=1 


be the linear combination (42) achieving the minimum A, where, of course, 
the point («?,..., a) lies on the sphere é,_,. As before, we can show 
that the sequence {y?(x)} converges uniformly to a limit function y(x) 
which satisfies the Sturm-Liouville equation (37) [with A = A], the boun- 
dary conditions (38), the normalization condition (39), and the orthogonality 
condition (41). In other words, y(x) is the eigenfunction of the Sturm- 
Liouville problem corresponding to the eigenvalue 4°”. Since orthogonal 
functions cannot be linearly dependent, and since only one eigenfunction 
corresponds to each eigenvalue (except for a constant factor), we have the 
strict inequality 
XD < A, 


instead of (44). Finally, we note that by repeating the above argument, 
with obvious modifications, we can obtain further eigenvalues \‘”, A, ..., 
and corresponding eigenfunctions yx), y“(x),.... 

For further material on the use of direct methods in the calculus of varia- 
tions, we refer the reader to the abundant literature on the subject.!* 


14 See e.g., N. Krylov, Les méthodes de solution approchée des problémes de la physique 
mathématique, Mémorial des Sciences Mathématiques, fascicule 49, Gauthier-Villars 
et Cie., Paris (1931); S. G. Mikhlin, Mpamsre Metogs: B Matemaruyeckon Duznke 
(Direct Methods in Mathematical Physics), Gos. Izd. Tekh.-Teor. Lit., Moscow (1950); 
S. G. Miknlin, BapvaunonHpie Metogbr 8 Matematuyecxonh @u3nxe (Variational 
Methods in Mathematical Physics), Gos. Izd. Tekh.-Teor. Lit., Moscow (1957); L. V. 
Kantorovich «nd V. I. Krylov, Approximate Methods of Higher Analysis, translated 
by C. D. Benster, Interscience Publishers, Inc., New York (1958). 
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PROBLEMS 


1. Let the functional J[y] be such that J[y] > — oo for some admissible 
function, and let 
supJ[y] = p< +0, 


where sup denotes the least upper bound or supremum. By analogy with the 
treatment given in Sec. 39, define a maximizing sequence, and then state and 
prove the corresponding version of the theorem on p. 194. 


2. Use the Ritz method to find an approximate solution of the problem of 
minimizing the functional 


Ji = [G2 - 7 - 2xy) dx, (0) = HUI) = 0, 


and compare the answer with the exact solution. 
Hint. Choose the sequence {9,(x)} (see p. 195) to be 


x(l—x), x71 — x), x3(1 — x)... 


3. Use the Ritz method to find an approximate solution of the extremum 
problem associated with the functional 


1 
JU) = |, @y? + 100xy? ~ 20x») dx, y(1) = »'() = 0. 
Hint. Choose the sequence {9,(x)} to be 
(x — 1)7, x(x — 1)?, x*(x — 1)?,... 
4. Use the Ritz method to find an approximate solution of the problem of 
minimizing the functional 
2 
Jy) = [G7 + + 2xy)dx, (0) = y2) = 0, 

and compare the answer with the exact solution. 


5. Use the Ritz method to find an approximate solution of the equation 
yu | Ou 


ie ae 


inside the square 
R: -a<x<a, -asgysa, 
where u vanishes on the boundary of R. 


Hint. Study the functional 


ro ff [+ (a ~ 2 ea 


and choose the two-dimensional generalization of the sequence {¢,(.x)} to be 


(x? — a?)(y? — 67), (x? + y?)(x? — a?)(y? ~ 67),.... 
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6. Write the Sturm-Liouville equation associated with the quadratic functional 
b 
JU = |’ ey? + oy) de, 
where c and c, > 0 are constants, subject to the boundary conditions 


ya)= 0, y(b)=0. 


Find the corresponding eigenvalues and eigenfunctions. 


7. Formulate a variational problem leading to the Sturm-Liouville equation 
(14) subject to the boundary conditions 


y(a)=0, yb) =0, 
instead of the boundary conditions (15). 
Hint. Recall the natural boundary conditions (29) of Sec. 6. 


8. Prove that any function A(x) € Z,(0, x) satisfying the boundary conditions 
(28) can be approximated in the mean by a linear combination 


h(x) = > C™ sin rx, 
r=l] 


where at the same time A,(x) approximates A’(x) and An(x) approximates 
h’(x) [in the mean]. Show that the coefficients C{ need not depend on 7 
and can be written simply as C,. 


Hint. Form the Fourier sine series of A’(x) and integrate it twice term by 
term. 


9. Show that if f,(x) —> f(x) in the mean and g,(x) — g(x) uniformly in some 
interval [a, 6), then 


PP feedena) dx -- f° edger) de. 


Hint. Use Schwarz’s inequality. 


Appendix I 





PROPAGATION OF DISTURBANCES 
AND THE 
CANONICAL EQUATIONS’ 


In this appendix, we consider the propagation of “‘disturbances” in a 
medium which is regarded as being both inhomogeneous and anisotropic. 
Thus, in general, the velocity of propagation of a disturbance at a given point 
of the medium will depend both on the position of the point and on the 
direction of propagation of the disturbance. We also make the following 
two assumptions about the process under consideration: 


1. Each point can be in only one of two states, excitation or rest, i.¢., no 
concept of the intensity of the disturbance is introduced. 


2. If a disturbance arrives at the point P at the time ¢, then starting from 
the time 7, the point P itself serves as a source of further disturbances 
propagating in the medium. 


In the analysis given here, our aim is to show that a study of processes 
of excitation of the kind described, together with purely geometric considera- 
tions, can be used to derive such basic concepts of the calculus of variations 
as the canonical equations, the Hamiltonian function, the Hamilton-Jacobi 
equation, etc. The treatment given here does not rely upon the derivations 
of these concepts given in the main body of the book (see Secs. 16, 23), and in 
fact can be used to replace the previous derivations. The reader acquainted 


* The authors would like to acknowledge discussions with M. L. Tsetlyn on the 
material presented here. 
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with optics will recognize that we are essentially constructing a mathe- 
matical model of the familiar Huygens’ principle.” 


1. Statement of the problem. Let the medium in which the disturbance 
propagates fill a space 2, which for simplicity we take to be n-dimensional 
Euclidean space. Thus, every point x EZ is specified by a set of n real 
numbers x?,..., x". Choosing a fixed point x» € Z, we consider the set of 
all smooth curves 


x = x(s) (1) 


passing through xo. The set of vectors tangent to the curve (1) at the point 
Xo, 1.e., the set of vectors 


forms an n-dimensional linear space, which we call the tangent space to & at 
x, and denote by Y(x,). Note that the end points of the vectors in any 
tangent space Y (x) are points of Z itself.? 

Since the medium is inhomogeneous and anisotropic, the velocity of 
propagation of disturbances in 2 depends on position and direction, i.e., 
on x and x’. Let f(x, x’) denote the reciprocal of this velocity. Then, if 
x(s) and x(s + ds) are two neighboring points lying on some curve x = x(s), 
the time dt which it takes the disturbance to go from the point x(s) to the 
point x(s + ds) can be written in the form 


dx 
as f(x, =| ds, 


and the time it takes the disturbance to propagate along some infinite path 
joining the points x» = x(So) and x, = x(s,) equals 


ie f(s | as (2) 


Suppose the point x, is “‘excited,’’ and consider all possible paths joining 
Xo and x,. Then, because of the “‘off or on” character of the excitation, 
the only path which plays any role in the propagation process is the one along 
which the disturbance propagates in the smallest time, say t. (Disturbances 
arriving at x, via some other path which is traversed in a time >t will arrive 


?See eg., B. B. Baker and E. T. Copson, The Mathematical Theory of Huygens’ 
Principle, Oxford University Press, New York (1939). 

3 In the case considered, the tangent space 7 (x) is particularly simple, and in fact, 
is just an n-dimensional Euclidean space with origin at x. More generally, 2 can be an 
n-dimensional differentiable manifold, and then the end points of vectors in 7 (x) need 
no longer lie in 7. However, the analysis given below can easily be extended to this 
case, by exploiting the ‘‘local flatness”’ of :2’. 
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at x, “too late” to have any further effect on the propagation process, 
since x, will already be found in a state of excitation.) In other words, 


7 = min ie ds, 
So 


where the minimum is taken with respect to all curves x = x(s) joining the 
points xX, and x,. Thus, the propagation of disturbances in the medium 
obeys the familiar Fermat principle (p. 34), i.e., among all paths joining x 
and x,, the disturbance always propagates along the path which it traverses 
in the least time. We shall refer to such paths as the trajectories of the 


disturbance. 
Next, we state a physically plausible set of properties for the function 


f(x, x’): 
1. The propagation time along any curve is positive, and hence 
S(xyx)>0 if x 40. (3) 


2. The propagation time along any curve y joining x, and x,, given by 
the integral (2), depends only on y and not on how y is parameterized. 
It follows by the argument given in Chap. 2, Sec. 10 that f(x, x’) is 
positive-homogeneous of degree | in x’: 


T(x, Ax’) = f(x, x’) forevery A> 0. (4) 
In particular, (4) implies that 
f(x, x! + ') = f(x, x’) + f(x, ¥), (5) 
if x’ = Ax’, where A > 0. 
3. The time it takes a disturbance to traverse a curve y connecting Xo to x; 


is the same as the time it takes a disturbance to traverse y in the opposite 
direction from x, to Xo, and hence 
f(x, —x’) = f(x, x’). (6) 
4, If the medium is homogeneous, so that fis a function of direction only, 
then the disturbance propagates in straight lines (see Prob. 1). In 
particular, no disturbance emanating from a given point x9 can arrive 
at another point x, more quickly by taking a path consisting of two 
straight line segments than by going along the straight line segment 
joining x) and x,. This implies the convexity condition 


SK + ¥) < f(%) + SE) 


(see Prob. 2). If jf depends on x in a sufficiently smooth way (e.g., if 
the derivatives 0//0x', ..., 6f/@x" exist), the same argument shows that 
the convexity condition 


Lx + ¥) <f(% x) + Sx, ¥) (7) 
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holds for sufficiently small x’, x’, but then (7) holds for all x’, x’ because 
of the homogeneity property (4). 


5. Actually, we strengthen the condition (7) somewhat, by requiring that 
f satisfy the strict convexity condition, consisting of (7) plus the stipula- 
tion that (5) holds only if x’ = Ax’, where d > 0. 


Now suppose we have a disturbance which at time t = 0 occupies some 
region of excitation R in 2, and propagates further as time evolves. The 
boundary of R will be called the wave front. Let 

S(x, t) = 0 
be the equation of the wave front at the time #. Then our problem can 
be stated as follows: Find the equation satisfied by the function S(x, t) 
describing the wave front, and find the equations of the trajectories of the 
disturbance. 


2. Introduction of a norm in 7 (x). Our next step is to use the function 
f(x, x’) to introduce a norm in the n-dimensional tangent space 7(x). This 
can be done by defining the norm of the vector x’ = 0 to be zero and setting 


Ix" =F +) (8) 


for all vectors x’ # Oin. 7 (x). The fact that ||x’|| actually meets all the require- 
ments for a norm (see p. 6) is an immediate consequence of (3), (4), (6) 
and (7). The set of all vectors in 7 (x) such that 


F(x, x') = |x’ = (9) 


is called a sphere of radius « in 7 (x), with center at the point x. The sphere 
(9) is just the boundary of the closed region of 7 (x) [and hence of 2] which 
is excited during the time « by a disturbance originally concentrated at the 
point x. In this language, our problem can be rephrased as follows: 
Suppose a tangent space J (x), equipped with the norm (8) satisfying the strict 
convexity condition, is defined at each point x of an n-dimensional space 2. 
Find the equations describing the propagation of disturbances in 2, if during 
the time dt the disturbance originally at x ‘‘spreads out and fills” the sphere 


S (x, dx) = dt. 


3. The conjugate space TF (x). Let g[x’] be a linear functional (see p. 8), 
defined on the tangent space .7(x). Then there is a unique vector 


P =, (Pi, eat > Pr)s 
such that 
p[x'] = (p, x’) 
for all x’ € 7 (x), where by (p, x’) is meant the scalar product 


n 
> PY bos + Pax 
t=1 
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(see Prob. 3). Conversely, any scalar product (p, x’) obviously defines a 
linear functional on 7 (x). The set of all linear functionals on .7(x), or 
equivalently the set of all vectors p, is itself an n-dimensional linear space, 
called the conjugate space of 7 (x) and denoted by TJ (x). We define the 
norm of a vector p € J (x) by the formula® 


= sup (2X), 
|p| = sup Fal (10) 


where the least upper bound is taken over all vectors x’ # 0 in 7 (x) [see 
Prob. 4]. In the present context, we write H(x, p) instead of ||pll, i.e., 





H(x, p) = sup Go (11) 


It can be shown that the transition from the function f(x, x’) to the function 
H(x, p) defined by (11) is just the parametric form of the Legendre transfor- 
mation discussed in Sec. 18. 


4. The propagation process. Suppose the wave front at the time ¢ is the 
surface o,, with equation 
S(x, t) = 0. (12) 


We now examine in more detail the mechanism governing the evolution of o,; 
in time. By hypothesis, each point of o serves as a source of new distur- 
bances, which during the time dt excite the region bounded by the sphere 


F(x, dx) = dt. (13) 


Since the function f(x, x’) determining the propagation process is assumed to 
be differentiable and strictly convex (in the sense explained above), there is a 
unique hyperplane tangent to each point of the sphere (13), and this hyper- 
plane has only one point in common with the sphere. i.e., its point of tangency. 
If we construct a family of spheres (13), one for each point x €o,, then the 
wave front o,44: at the time ¢ + df, with equation 


S(x,t + dt) = 0, (14) 


is just the envelope E of this family of spheres. In fact, E is the ‘‘interface”’ 
separating the points of 2 which can be reached from a, in times <dt from 
the points which can only be reached from o, in times >df. This construction 
has two important implications: 


* The reader familiar with tensor analysis will note that here we make a distinction 
between contravariant vectors like x’, with components x'’ indexed by superscripts, 
and covariant vectors like p, with components p, indexed by subscripts. See e.g., 
G. E. Shilov, op. cit., Sec. 39. 

5 By sup is meant the least upper bound or supremum. 
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1. Given a point x €o;, there is a unique point x + dx € 6,4, which is 
excited after the time dt by a disturbance initially at x. In fact, x + dx 
is the point of o:44 lying on the (unique) hyperplane tangent to both 
(13) and a+; To see this, we observe that it takes a time >dt fora 
disturbance starting from x to reach any other point of o;,4;.6 Thus, 
there is a unique direction of propagation defined at each point x €o,, 
and it is clear that a disturbance leaving x in this direction will arrive at 
the surface o,, 4, more quickly than a disturbance leaving x in any other 
direction, as required by Fermat’s principle. 


2. Conversely, given a point x + dx €o,,,,, there is a unique point 
x €o;, which at the time ¢ was the source of the disturbance reaching 
x + dx atthetimez+ dt. In fact, x is just the center of the (unique) 
sphere of radius dt which shares a tangent hyperplane with o; . a. 


5. The Hamilton-Jacobi equation. As was just shown, every hyperplane 
tangent to the surface o;,,, with equation (14) must also be tangent to some 
sphere of radius dt whose center lies on the surface o, with equation (12). 
This fact can be used to derive a differential equation satisfied by the function 
S(x, t). First, we observe that every hyperplane in the tangent space 7 (x) 
can be written in the form 


n 
> px" = const, 
f=1 


where p = (pi,..., Pp) is a vector in the conjugate space TF (x). Let x + dx 
be an arbitrary point of o,,4,, whose “‘source” is the point x € o,. Then 
the hyperplane in 7 (x) tangent to o:44, at x + dx has the equation 


ae .dt =<, (15) 


where c is a constant. If the hyperplane (15) is also tangent to the sphere 
(13), as required, then c equals the norm of the vector 


oS aS 
ox! ax]? 





vs = (5 


multiplied by the radius of the sphere, i.e., 
c = H(x, VS) dt. 


Therefore, (15) becomes 


oy 
+ ax! 


ae 


dx = H(x, VS) dt. (16) 


® Physically, this means that if the surface o; is changed only in a small neighborhood 
of the point x, the surface o,.4, is also changed only in a small neighborhood of x + dx. 


214 PROPAGATION OF DISTURBANCES APPENDIX I 


But 


as 
sida! + = dt = 0, (17) 


because of the meaning of x and x + dx. Comparing (16) and (17), we 
finally obtain 


= + H(x, VS) = 0. (18) 
This equation describes the way the wave front evolves in time, and is just 
the familiar Hamilton-Jacobi equation, already considered in Sec. 23. 

We now show the relation between the trajectories of the disturbance and 
the general solution of (18). It will be recalled that as a wave front evolves 
in time, each of its points goes into a succession of uniquely defined points 
lying on neighboring wave fronts, thereby “‘sweeping out” a trajectory y 
which automatically minimizes the functional (2). Thus, if we specify a 
one-parameter family of wave fronts 


S(x, t) = 0, (19) 


where the parameter is the time ¢, every point x) on some “initial” surface 
S(x, to) generates a trajectory. Choosing the point x arbitrarily, we find 
that the one-parameter family of surfaces (19) determines an (n — 1)- 
parameter family of trajectories, such that one and only one trajectory of the 
family passes through each point xe. More generally, let 


S(x, f, 1). - +) Xn) 


be a complete integral of the Hamilton-Jacobi equation depending on n 
parameters «,,...,a,. This complete integral determines an (n + 1)- 
parameter family of surfaces’ 


S(x, t, a1,..-,%,) = 0, (20) 


which in turn determines a (2n — 1)-parameter family of trajectories. Then 
the fact that the trajectories of the disturbances are the extremals of the 
functional (2) leads to a geometric interpretation of Jacobi’s theorem (p. 91), 
concerning the construction of a general solution of the system of Euler 
equations of a functional from a complete integral of the corresponding 
Hamilton-Jacobi equation.® 


7 Since S(x, t + fo, 01,...,%n,) = 0 is also an integral surface of the Hamilton-Jacobi 
equation forarbitrary fo, the family of surfaces (20) actually depends on » + | parameters. 

® Jt should be noted that we are considering a parametric problem, so that there 
is dependence between the Euler equations (see Sec. 10 and Remark 4 of Sec. 37). As 
a result, the general solution of the 2” equations obtained here contains only 2” — 1 
arbitrary constants. 
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6. The canonical equations. To derive the differential equations satisfied 
by the trajectories of the disturbance, we might use Fermat’s principle, 
minimizing the functional (2) and solving the corresponding Euler equations. 
However, we prefer to use our geometric model of the propagation process. 
If we introduce the time ¢ as the parameter along each trajectory, it follows 
from 


T(x, dx) = dt 
and the homogeneity of f(x, dx) in the argument dx that 


f(x, 5) = 1, (21) 


i.e., the norm of the vector dx/dr is identically equal to |. Using (16), we 
find that at each point x, the vector dx/dt (tangent to the trajectory along 
which the disturbance propagates) is related to the covariant vector p 
(determining the hyperplane tangent to the wave front) by the formula 


< dx! 
2 rai a H (x, p). 


According to (21) and the definition (11) of the norm of vectors in TF (x), 
we see that 


if p is any other vector in F (x). Thus, the expression 


c dx! 
> a 7 AGP) 


regarded as a function of p, achieves its maximum when p is the vector 
determining the hyperplane tangent to the wave front. Therefore, along 
the trajectories, the conditions 


afs_ dx' 
we LDP ar ~ Hosa] =0 @ =1,...,” 


must hold, i.e., 

dx'  0H(x, p) 3 

—_— = Sc 1,.o2.5:%): 

i ap, (= 1,...,”) (22) 

We have just obtained a system of ordinary differential equations of the 

first order satisfied by the trajectories. Since these equations involve 2n 
unknown functions x1,..., x" and p,,..., P,, we Still need n more equations 
to completely describe the trajectories. To find the missing equations, 
we use the fact that the surfaces representing the wave fronts at different times 
are not arbitrary, but satisfy the Hamilton-Jacobi equation (18), while the 
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values p, at each point of a trajectory are the components 05/éx' determining 
the hyperplane tangent to the wave front. In other words, 


P= PA) = SEO, "Os 


along each trajectory, and hence 


dy _ d OS _ 00S, > _ OS dt 


dt ~ de oxi wax * 2. ox" ox dt 


We now introduce the following notation: If the function H(x, p), where 





P, = 0S/0x,, is regarded as a function of x1,...,x" and tf, we indicate its 
partial derivative with respect to x! by 

oH 

Ox" |= const 
whereas if H(x, p) is regarded as a function of the 2n variables x!,..., x" 
and p;,..., Ppa, We indicate its partial derivative with respect to x' by 

oH 

x! |p =const 





Then, using the Hamilton-Jacobi equation (18), we can write (23) in the form 

















dp, _ = OH = 87S dx* 
rau 1 Weert Z Ox ox dt (24) 
Along the trajectories, we have 
oH oH - OH 2) 
éx' t=const ox* p=const 2 opi, z=const ox! ( ) 
and 
os dx* 0H 
Pe Oxt  dt = Oy Go) 
Substituting (25) and (26) into (24), we obtain n differential equations 
dp; = oH oie 
Pam) eee (i = 1,...,n). 





Combining these equations with (22), we obtain a system of 2n differential 
equations 


dx! _ 0H(x, p) 
dt Op; (27) 
dp, winds OH (x, P), 
dt ox! 
where i = 1,...,”. The integral curves of (27) are the trajectories along 


which the disturbance propagates, i.e., the extremals of the functional (2). 
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The system (27) is of course the canonical system of Euler equations for the 
variational problem associated with (2) [cf. Sec. 16], and represents the so- 
called characteristic system associated with the Hamilton-Jacobi equation 


(18) [cf. p. 90]. 


PROBLEMS 


1. Prove that if f(x, x’) depends on direction only, then the disturbance 
propagates through the medium along straight lines. 


2. Prove that if f(x, x’) = f(x’) is independent of x, then f(x’) is precisely 
the time required to traverse the vector x’. 


3. Prove that every linear functional [x] defined on an »-dimensional 
Euclidean space of points x = (x!,..., x") is of the form 


plx] = pixt + +++ + pax’, 
where p = (pi,..., Pn) is uniquely determined by 9. 
4. Verify that formula (10) actually defines a norm for the elements p of the 
conjugate space 7 (x). 


5. Why is the strict convexity condition (p.2!1) needed in constructing 
wave fronts for the disturbance? 


Appendix Il 


VARIATIONAL METHODS 
IN PROBLEMS OF 
OPTIMAL CONTROL 








In this appendix, we sketch some results obtained by L. S. Pontryagin 
and his students, in their investigations of the theory of optimal control 
processes.. The connection between this subject and classical variational 
theory will also be discussed. 


1. Statement of the problem. In many cases, finding the optimal “ operating 
regime” for a physical system (with a suitable optimality criterion) leads 
to the following mathematical problem: Suppose the state of the physical 
system is characterized by n real numbers x’,..., x", forming a vector 
x = (x},..., x") in the n-dimensional “phase space” 2 of the system, 
and suppose the state varies with time in the way described by the system 
of differential equations 


Oo PN aul) (§ = 1,..., n). (1) 
Here, the & real numbers uw}, ..., u* form a vector u = (u',..., u*) belonging 


to some fixed “control region” (, which we take to be a subset of 


‘See L. S. Pontryagin, Optimal control processes, Usp. Mat. Nauk, 14, no. 1, 3 (1959); 
Vv. G. Boltyanski, R. V. Gamkrelidze and L. S. Pontryagin, The theory of optimal 
processes, 1, The maximum principle, tzv. Akad. Nauk SSSR, Ser. Mat., 24, 3 (1960); 
L. S. Pontryagin, V. G. Boltyanski, R. V. Gamkrelidze and E. F. Mishchenko, The 
Mathematical Theory of Optimal Processes, translated and edited by K. N. Trirogoff and 
L. W. Neustadt, Interscience Publishers, New York (1962). The more general case 
where Q) is a topological space is considered in the first two references. 
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k-dimensional Euclidean space, and the f‘(x, uw) are 1 continuous functions 
defined for all x €% and all ue Q. 

Now suppose we specify a vector function u(t), fp < t < t,, called the 
control function, with values in Q. Then, substituting u = u(t) in (1), we 
obtain the system of differential equations 


Caf VO. KO C= 


For every initial value x9 = x(fo), this system has a definite solution, called 
a trajectory. The aggregate 


U = {u(t), to, ti, Xo}s (3) 


consisting of a control function u(t), an interval [fo, t,;] and an initial value 
Xo = X(to), will be called a control process. Thus, to every control process, 
there corresponds a trajectory, i.e., a solution of (2). 
Next, let 
fx},..., ¥", u,..., u*) 


be a function which is defined, together with its partial derivatives 


of° 


‘ox! 


forall xe ZandueQ. To every control process U, we assign the number 


(= 1,...,2), 


JU) = f° Fx w a, (4) 


i.e., J[U] is a functional defined on the set of control processes. Then, 
the control process (3) is said to be optimal if the inequality 


J{[U] < J[U*] 


holds for any other control process U* carrying the given point x) into the 
point x, i.e., such that the corresponding trajectory x*(t) satisfies the con- 
dition x*(t*) = x,. By the optimal trajectory, we mean the trajectory 
corresponding to the optimal control process. Our aim is to find necessary 
conditions characterizing optimal control processes and optimal trajectories. 

It should be pointed out that in calling a control process optimal, it is 
assumed that some class of admissible control processes has been specified in 
advance. Here, we assume that the components wi(t),..., u*(t) of any 
admissible control process take values in Q, and are bounded and piecewise 
continuous (with left-hand and right-hand limits at every point of dis- 
continuity). 

An important special case of the problem of optimal control is the situation 
where the functional (4) reduces to the integral 


ty 
dt, 
to 
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representing the time it takes to go from the point xo to the point x;. 
In this case, optimality means taking the least time to go from xq to x;. 


2. Relation to the calculus of variations. The problem of optimal control 
is intimately related to certain traditional problems of the calculus of 
variations. In fact, the integral 


i‘ f(x, u) dt 


can be regarded as a functional depending on n + k functions x},..., x", 
u},..., u*, i.e., as a functional defined on some class of curves inn + k + 1 
dimensions. Since the functions x},..., x", u’,..., u* are connected by the 
equations (1), we are dealing with the problem of finding a minimum subject 
to nonholonomic constraints (see p. 48). Since the boundary conditions are 
equivalent to the requirement that the desired optimal trajectory x(t) begin 
at the point x. and end at the point x,, the end points of the admissible curves 
in our (n + k + 1)-dimensional space have to lie on two (k + 1)-dimensional 
hyperplanes, determined by giving the coordinates x’, ..., x” the fixed values 
xh,..., xR and xt,..., x7. 

Thus, we see that the problem of optimal control is a variant of the problem 
of finding a minimum subject to subsidiary conditions. The problem of 
optimal control has the special feature that we specify in advance a definite 
class of admissible control processes, where the functions u'(f),..., u*(f) 
are required to take values in a given fixed region Q, but in general are not 
required to be continuous. 

We can easily show that the simplest n-dimensional variational problem, 
where the integrand does not depend on / explicitly,” is a special case of the 
problem of optimal control. To this end, suppose that among the curves 
passing through two fixed points 


(x6, ---5 0), (XT. 9), 
it is required to find the curve for which the functional 
fy dx} dx" 
‘0 1 Ry ee —— 
PR BY Gi FE) et (5) 


has a minimum. To paraphrase this problem as a problem of optimal 
control, we need only write (5) in the form 


fy 
f(x}, ..., x u,..., u*) dt, 
te) 


and take the system (1) to be simply 
dx’ i — 
aoe @ = 1,..., 7). 


2 This condition is not really a restriction, since any functional can be transformed 
into this form, e.g., by going over to the parametric form of the problem. 
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3. Necessary conditions for optimality. To find necessary conditions for 
a given control process and the corresponding trajectory to be optimal, we 
supplement the system of equations 


dx' 


with the extra equation 
dx°® 


“dt. = L(x, u), 


where f°(x, u) is the integrand of the functional (4) which is to be minimized. 
At the same time, we supplement the initial conditions 


X'(to) = x4 G@ = 1,...,”) (6) 
with the extra condition 
X%(fo) = 0. (7) 
For convenience, we introduce the (n + 1)-dimensional vector function 


x(t) = (x°(1), x(D) = (°(1), x7(2), .. -, x(0))- 
It is clear that if U is an admissible control process and if x = x(t) is the 
solution of the system® 


d ai : 3 
Gr = fix w) (= 0,1,...,n), (8) 
corresponding to U and the initial conditions (6) and (7), then 
ty 
JtU] = f° f(x, u) dt = x%(t,). 
to 


Thus, the problem of optimal contro! can be stated as follows: Find the 
admissible control process U for which the solution x(t) of the system (8), 
satisfying the initial conditions (6) and (7), has the smallest possible value of 
x(t). 

Next, in addition to the variables x°, x!,..., x", we introduce new variables 
Vo, Yi,---, Yn Satisfying the following system of differential equations, known 
as the conjugate* of the system (8): 


th . 5 Pew y, (=O, (9) 


a=0 ¢ 


3 Note that the functions f*, and hence the functions II and A defined below, do not 
involve x°(r). 

4 This system has the following geometric interpretation: In the space of vectors 
(Uo, Yi, -..) Yn) Conjugate to the space of vectors (x°, x’,..., x") [see p. 211], consider 
the hyperplane 


> Uox, = ¢ = const 

a=0 
passing through the initial point (0, xi,..., 3). Then the system (9) describes the 
‘transport’ of this hyperplane along the trajectories corresponding to solutions of the 
system (8). In other words, if the ), satisfy (9) and the x‘ satisfy (9) for fp < ¢ < h, then 


n 
D wea eee ren), 
«=0 


For more details, see the second of the references ciled on p. 218. 
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Let 
p(t) = (Yo(t), dit), ae (2), 


and consider the following function of the variables x’, ..., x", Yo, dy, -- +> Vans 
Uy,.. 2, Ug! 


Mp, x, u) = 2 Yof* u). (10) 
a“=0 
In terms of IT, we can write the equations (8) and (9) in the form 
dx' al 
‘dt (Oh, 
(11) 
dy _ _ all 
dt sox” 
where = 0,1,..., 7. The equations (11) remind us of the canonical system 


of Euler equations [see formula (11), p. 70]. However, they have a different 
meaning, since the canonical equations form a closed system, in which the 
number of equations equals the number of unknown functions, whereas (11) 
involves not only x and } but also the unknown function u, and hence (10) 
becomes a closed system only when u is specified. In fact, in order to write 
equations for the optimal control problem resembling the canonical equations, 
we would have to use the function 


A(H, x) = sup II(, x, 4), (12) 
instead of the function IT(p, x, u).5 


4. The maximum principle. We can now state the following theorem, 
whose proof can be found in the references cited on p. 218: 


THEOREM (The maximum principle). Let U = {u(t), to, t1, Xp} be an 
admissible control process, and let x(t) be the corresponding integral curve 
of the system (8) passing through the point (0, x, ..., x8) for t = 0, and 
satisfying the conditions 


x1(t;) = x},..-, X44) = x? 


for t = t,. Then if the control process U is optimal, there exists a con- 
tinuous vector function Y(t) = (Yo(t), Vilt), ..-, Palt)) such that 


1. The function p(t) satisfies the system (9) for x = x(t), u = u(t); 


5 The transition from II to # is analogous to the Legendre transformation, considered 
in Sec. 18. 
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2. For all t in [to, t,], the function (10) achieves its maximum for 
u = u(t), ie., 


M[p(t), x(2), u(t)] = H[p(o), x(2)], (13) 
where the function # is defined by (12); 


3. The relations 


bolts) < 0, #[p(t,), u(t,)] = 0 (14) 


hold at the time t,. Actually, if p(t), x(t) and u(t) satisfy the system 
(8), (9) and the condition (13), the functions V(t) and #[(t), x(t)] 
turn out to be constants, and hence in (14) we can replace t, by any 
value of t in [to, ty]. 


Remark 1, The maximum principle can often be used as a prescription for 
constructing the optimal trajectory, in the following way: For every fixed 
and x, we find the value of u for which the expression 


>, baf*(x, u) 
a=0 
takes its maximum. If this determines u as a single-valued function 


u = u(y, x) (15) 


of and x, then, substituting (15) into the equations (8) and (9), we obtain 
a closed system of 2(n + 1) equations involving 2(n + 1) unknown functions. 
These are just the equations which have to be satisfied by the optimal 
trajectory. 


Remark 2. For the simple n-dimensional variational problem discussed 
on p. 220, the system (8), (9), or the equivalent system (11), together with the 
maximum principle, reduces to the usual system of Euler equations. To see 
this, consider the functional 


ec eee u',...,u") dt (16) 
to 
[cf. (5)], where 
i 
wn @ =1,...,7). (17) 


In this case, the function (10) is 


T(p, x, u) = of (x, u) + D, Yau, (18) 
a=1 
and the system (11) becomes 
dx 4g a 
GAL, a =H 
die _ ty _y, Pw, 
dt’ dt ox! 
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where i? = 1,...,”. Maximizing II(, x, uw), we find that 
i.e., 


Since d))/dt = 0, we have ) = const, and hence 


d [ef (x, uv) af (x, u) 
dt | oot)! 

dx' 

a 
This is just the system of Euler equations corresponding to the functional 
(16), reduced to a system of first-order differential equations by introducing 
the derivatives dx'/dt = u‘ as new functions (cf. p. 68). 


Remark 3. In Appendix 1, we have already encountered the fact that every 
propagation process can be described in two ways, either in terms of the 
trajectories along which the disturbance propagates (the “‘rays”’ in optics), 
or in terms of the motion of the wave front. The first approach leads to the 
canonical Euler equations (or, as in the example just considered, to the 
usual form of the Euler equations), i.e., a system of ordinary differential 
equations. The second approach leads to the Hamilton-Jacobi equation, 
i.e., a partial differential equation. Our maximum principle involves the 
study of trajectories, and in this sense is analogous to the method of canonical 
equations. The “wave front approach” to problems of optimal control 
has been developed by R. Bellman.® 


5. Relation to Weierstrass’ necessary condition. We again consider the 
simple functional (16), (17), where the function IT(«p, x, u) is given by (18). 
Using (17), we can also write the functional (16) in the form 


ty 
| fH, 25 x", x, x”) dt. (19) 
to 


The Weierstrass £-function for such a functional is’ 


E(x, x',2) = 1% 2) — P52) — DY - MPeOox).—20) 


® See the relevant references cited in the Bibliography, p. 227. 
7See p. 146. Note that E is a function of three rather than four arguments, since (19 
is independent of ¢. 
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Using (18) and (20), we find that 
Tisp, x, z) — TI(, x, x’) — > (Zz, — x") os TI(p, x, x’) 
= YoS CH, 2) = Hof x) + > WG = ¥)— DG = xf + 40 


i= 


= Hof (x, 2) — Pof(x, x’) — > (2 — x" oft = Yok(x, x’, z). (21) 


If the function II achieves its maximum for values of u = x’ which are 
interior points of the region Q, then 
oll 
aut — ° 
at these points. Then, since }, < 0, it follows from (21) that the condition 
(13) is equivalent to the condition 


E(x, x’, z) > 0. (22) 
This is Weierstrass’ necessary condition, with which we are already familiar 


(see p. 149). Thus, the maximum principle leads to another, independent 
derivation of (22). It can be shown that the formula 


JoE = Mh, x,2) - Mx x) - 3 MAM x, 2) 


remains true for variational problems subject to constraints, i.e., for more 
general problems of optimal control. 

We have just proved the equivalence of the maximum principle and 
Weierstrass’ necessary condition (22) in the case where the set 2 of admissible 
values of the control function u(t) is open, i.e., where every point of Q is an 
interior point. In the case where the optimal control process involves values 
of u(t) lying on the boundary of the region Q, the condition (22) is in general 
no longer valid. However, it can be shown that in such cases, the maximum 
principle continues to apply. 


PROBLEMS 


1. State the maximum principle (p. 222) for the problem of ‘‘fastest motion” 
or ‘time optimal problem,”’ where the functional (4) reduces to simply 


J{U] = ie dt. 


Ans. In this case, we write 


PY, XU) = > ba f(x, w) 


a=1 
instead of (10), and in the system (11), f need only range from | tom. The 
function .#” in the maximum principle is now replaced by 


H(b, x) = sup PY, x) = Ap, x) — do. 
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Finally, the relations (14) are replaced by 
Aly(t1), x(1)] = —%o 2 0, 
which actually holds for any ¢ in [fo, f,). 


2. Consider the differential equation 

d?x 

de 4, (a) 
where the control function u obeys the condition |u| < 1. Introducing the 
“phase coordinates” x! and x?, we can write (a) as a system 

dx? dx? 

a = x?, a = lt. (b) 
What trajectory corresponds to the fastest motion from a given initial point 
Xo to the final point x, = (0, 0)? 


Hint. The auxiliary variables }, and {2 obey the equations 


By the maximum principle (modified in accordance with Prob. 1), 

u(t) = sgn a(t) = sgn (cz — e,f), 
where c, and ce are constants, sgn x = x/|x| and u(r) can only change sign 
once. Integrate the system (b) for u = +1, and draw the corresponding 


families of parabolas in the (x, x?) plane, analyzing the various possibilities 
(corresponding to different initial positions xo). 


3. Study the same “‘time-optimal problem” for the equation 


d?x 
qe teh jul <1. 


Hint, The appropriate system is now 


dx’, dx? 


= x + Ue. 


a? dt 


4. Study the same “‘time-optimal problem”’ for the system 


dx? dx? 
= =x? +t == -w +H 
dt . dt 
where there are fwo control functions u!, «? obeying the conditions || < 1, 


ju?| <1, 


Comment. For a detailed discussion of Probs. 2-4, see Chap. 1, Sec 5 
of the book cited on p. 218. 


5. Verify the relations (14) for the simple variational problem (16) discussed 
in Remark 2, p. 223. 


Hint. Use Euler’s theorem on positive-homogeneous functions (Chap. 2, 
Prob. 6). 
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